[ 533.341211] env[65016]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 533.341211] env[65016]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 534.344497] env[65106]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 534.344497] env[65106]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 536.157757] env[65106]: INFO neutron.common.config [-] Logging enabled! [ 536.158210] env[65106]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev51 [ 536.158310] env[65106]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65106) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 536.158554] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 536.158645] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 536.159461] env[65106]: WARNING oslo_policy.policy [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 536.159673] env[65106]: WARNING oslo_policy.policy [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 536.161374] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] VMware NSXv3 Agent initialized successfully. [ 536.161723] env[65106]: DEBUG oslo_concurrency.lockutils [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] Acquiring lock "singleton_lock" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.161855] env[65106]: DEBUG oslo_concurrency.lockutils [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] Acquired lock "singleton_lock" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.162068] env[65106]: DEBUG oslo_concurrency.lockutils [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] Releasing lock "singleton_lock" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.162358] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] Full set of CONF: {{(pid=65106) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 536.162469] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ******************************************************************************** {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 536.162571] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] Configuration options gathered from: {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 536.163219] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 536.163395] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 536.163503] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ================================================================================ {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 536.163669] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] agent_down_time = 75 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.163807] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] allow_automatic_dhcp_failover = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.163940] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] allow_bulk = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.164092] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] api_extensions_path = {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.164228] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] api_paste_config = api-paste.ini {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.164364] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] auth_strategy = keystone {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.164465] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] backdoor_port = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.164561] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] backdoor_socket = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.164694] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] backlog = 4096 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.164828] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] base_mac = fa:16:3e:00:00:00 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.164980] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] bind_host = 0.0.0.0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.165129] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] bind_port = 9696 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.165260] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] client_socket_timeout = 900 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.165396] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] config_dir = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.165504] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.165638] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] config_source = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.165771] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] control_exchange = neutron {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.165904] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] core_plugin = ml2 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.166049] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] debug = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.166185] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] default_availability_zones = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.166388] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.166526] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] dhcp_agent_notification = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.166656] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] dhcp_agents_per_network = 1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.166784] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] dhcp_lease_duration = 86400 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.166921] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] dhcp_load_type = networks {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.167070] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] dns_domain = openstacklocal {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.167207] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.167338] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] enable_default_route_bfd = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.167466] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] enable_default_route_ecmp = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.167591] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] enable_dvr = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.167716] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] enable_new_agents = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.167843] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.167970] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] enable_signals = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.168108] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] enable_traditional_dhcp = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.168232] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] external_dns_driver = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.168356] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] filter_validation = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.168496] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] global_physnet_mtu = 8950 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.168624] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] graceful_shutdown_timeout = 60 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.168801] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] host = cpu-1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.168938] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] host_dvr_for_dhcp = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.169078] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] http_retries = 3 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.169214] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] instance_format = [instance: %(uuid)s] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.169348] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.169481] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ipam_driver = internal {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.169609] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ipv6_pd_enabled = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.169737] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] l3_ha = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.169870] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.170038] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] l3_ha_network_physical_name = {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.170150] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] l3_ha_network_type = {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.170316] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_color = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.170418] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_config_append = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.170552] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.170678] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_dir = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.170803] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_file = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.170903] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_options = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.171043] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_rotate_interval = 1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.171181] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_rotate_interval_type = days {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.171315] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] log_rotation_type = none {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.171416] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.171513] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.171648] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.171779] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.171877] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.172013] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] max_dns_nameservers = 5 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.172144] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] max_header_line = 16384 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.172272] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] max_l3_agents_per_router = 3 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.172400] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] max_logfile_count = 30 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.172529] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] max_logfile_size_mb = 200 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.172653] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] max_subnet_host_routes = 20 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.172783] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] my_ip = 10.180.1.21 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.172931] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] my_ipv6 = ::1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.173056] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] network_auto_schedule = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.173181] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] network_link_prefix = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.173318] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.173457] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] notify_nova_on_port_data_changes = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.173588] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] notify_nova_on_port_status_changes = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.173724] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] pagination_max_limit = -1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.173851] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] publish_errors = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.173981] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] rate_limit_burst = 0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.174128] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] rate_limit_except_level = CRITICAL {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.174258] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] rate_limit_interval = 0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.174389] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] retry_until_window = 30 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.174517] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] router_distributed = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.174643] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] rpc_resources_processing_step = 20 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.174766] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] rpc_response_max_timeout = 600 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.174893] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] rpc_response_timeout = 60 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.175055] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] send_events_interval = 2 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.175163] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] service_plugins = ['router'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.175300] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] setproctitle = on {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.175428] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] shell_completion = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.175562] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] state_path = /opt/stack/data/neutron {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.175696] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] syslog_log_facility = LOG_USER {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.175825] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] tcp_keepidle = 600 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.175958] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] transport_url = **** {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.176100] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] use_journal = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.176228] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] use_json = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.176353] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] use_ssl = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.176480] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] use_stderr = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.176611] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] use_syslog = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.176733] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] vlan_qinq = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.176854] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] vlan_transparent = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.176975] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] watch_log_file = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.177115] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] wsgi_default_pool_size = 100 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.177241] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] wsgi_keep_alive = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.177373] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.177504] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] wsgi_server_debug = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 536.177649] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_concurrency.disable_process_locking = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.177788] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.177929] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.178075] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.178215] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.178350] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.178485] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.178631] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.connection_string = messaging:// {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.178770] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.enabled = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.178906] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.es_doc_type = notification {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.179050] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.es_scroll_size = 10000 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.179190] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.es_scroll_time = 2m {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.179324] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.filter_error_trace = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.179461] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.hmac_keys = **** {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.179599] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.sentinel_service_name = mymaster {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.179741] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.socket_timeout = 0.1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.179872] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.trace_requests = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.180024] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler.trace_sqlalchemy = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.180166] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler_jaeger.process_tags = {} {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.180316] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler_jaeger.service_name_prefix = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.180431] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] profiler_otlp.service_name_prefix = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.180577] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.enforce_new_defaults = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.180844] env[65106]: WARNING oslo_config.cfg [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 536.180991] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.enforce_scope = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.181148] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.policy_default_rule = default {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.181299] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.181441] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.181581] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.181713] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.181842] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.181970] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.182113] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.182251] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_policy.remote_timeout = 60.0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.182395] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.182541] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] agent.extensions = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.182679] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.182817] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] service_providers.service_provider = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.182957] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.default_quota = -1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.183120] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.183242] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_floatingip = 50 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.183375] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_network = 100 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.183510] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_port = 500 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.183640] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.183769] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_router = 10 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.183897] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_security_group = 10 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.184039] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.184173] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.quota_subnet = 100 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.184304] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] QUOTAS.track_quota_usage = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.184452] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.184583] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep.group = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.184711] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep.helper_command = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.184841] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep.log_daemon_traceback = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.184975] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.185121] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep.thread_pool_size = 8 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.185257] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep.user = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.185396] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.185526] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_dhcp_release.group = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.185652] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_dhcp_release.helper_command = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.185780] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.185914] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.186058] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.186189] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_dhcp_release.user = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.186326] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.186454] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_ovs_vsctl.group = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.186581] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_ovs_vsctl.helper_command = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.186711] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.186844] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.186975] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.187113] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_ovs_vsctl.user = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.187248] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_namespace.capabilities = [21] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.187375] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_namespace.group = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.187504] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_namespace.helper_command = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.187633] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_namespace.log_daemon_traceback = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.187765] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.187896] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_namespace.thread_pool_size = 8 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.188031] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_namespace.user = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.188169] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_conntrack.capabilities = [12] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.188296] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_conntrack.group = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.188426] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_conntrack.helper_command = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.188553] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.188684] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.188815] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.188940] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_conntrack.user = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.189086] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_link.capabilities = [12, 21] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.189216] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_link.group = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.189343] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_link.helper_command = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.189477] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_link.log_daemon_traceback = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.189611] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.189743] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_link.thread_pool_size = 8 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.189868] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] privsep_link.user = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.190027] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.190175] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.190322] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.continue_on_failed_promotions = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.190447] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.dscp = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.190579] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.dscp_inherit = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.190717] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.force_mp_to_policy = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.190846] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.locking_coordinator_url = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.190978] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.log_agent_heartbeats = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.191122] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.logging_expire = 1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.191261] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.191399] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.191539] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.polling_interval = 240 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.191671] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.191811] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.191953] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.report_interval = 30.0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.192102] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.192242] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.192380] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.192520] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.sync_skew = 60 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.192653] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.synchronization_queue_size = 20 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.192786] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT.use_helper_for_ns_read = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.192924] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] SECURITYGROUP.enable_ipset = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.193072] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] SECURITYGROUP.enable_security_group = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.193209] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.193348] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.193486] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] experimental.ipv6_pd_enabled = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.193639] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.extension_drivers = ['port_security'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.193771] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.external_network_type = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.193918] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.194071] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.overlay_ip_version = 4 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.194213] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.path_mtu = 8950 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.194352] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.physical_network_mtus = {} {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.194497] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.tenant_network_types = ['vlan'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.194636] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.194778] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ml2.type_drivers = ['vlan'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.194920] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT_CLI.neutron_port_id = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.195064] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.195199] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.195342] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.195485] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.195624] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.195759] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.195896] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.196041] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.196247] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.196393] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_login_password = **** {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.196537] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_login_port = 443 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.196675] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_login_user = admin {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.196811] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.196951] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.197095] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.197228] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.197367] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.197512] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.197648] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.197783] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.197917] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.198065] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.198217] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.198344] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.198484] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.198673] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.198817] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] vsphere.vsphere_login_password = VMware1! {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.198956] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.199101] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.199239] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.auth_section = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.199382] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.auth_type = password {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.199521] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.199648] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.certfile = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.199779] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.collect_timing = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.199918] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.endpoint_type = public {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.200068] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.insecure = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.200200] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.keyfile = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.200346] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.region_name = RegionOne {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.200479] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.split_loggers = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.200607] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] nova.timeout = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.200741] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.auth_section = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.200881] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.auth_type = password {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.201025] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.201158] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.certfile = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.201293] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.collect_timing = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.201438] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.endpoint_type = public {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.201566] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.insecure = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.201694] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.keyfile = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.201821] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.region_name = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.201950] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.split_loggers = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.202089] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] placement.timeout = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.202223] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.auth_section = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.202357] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.auth_type = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.202483] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.cafile = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.202610] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.certfile = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.202741] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.collect_timing = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.202870] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.connect_retries = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.202999] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.connect_retry_delay = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.203144] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.enable_notifications = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.203320] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.endpoint_override = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.203391] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.insecure = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.203518] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.interface = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.203643] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.keyfile = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.203772] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.max_version = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.203899] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.min_version = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.204036] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.region_name = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.204167] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.retriable_status_codes = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.204296] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.service_name = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.204423] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.service_type = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.204553] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.split_loggers = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.204677] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.status_code_retries = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.204802] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.status_code_retry_delay = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.204926] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.timeout = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.205064] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.valid_interfaces = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.205192] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ironic.version = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.205325] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] cli_script.dry_run = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.205469] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.205597] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.205726] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.205853] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.205981] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.206121] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.206249] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.206381] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.206513] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.206653] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.206782] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.206918] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.207064] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.207200] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.207330] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.207467] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.207596] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.207724] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.207860] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.207992] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.208137] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.208270] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.208401] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.208534] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.208664] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.208793] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.208921] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.209063] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.209192] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.209323] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.209453] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.ssl = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.209588] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.209724] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.209855] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.209990] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.210141] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.ssl_version = {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.210271] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.210416] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_notifications.driver = [] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.210550] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_notifications.retry = -1 {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.210692] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.210819] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] oslo_messaging_notifications.transport_url = **** {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 536.210938] env[65106]: DEBUG oslo_service.backend._eventlet.service [None req-28a6f21e-f461-4bee-8553-43ebad80b941 None None] ******************************************************************************** {{(pid=65106) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 536.212053] env[65106]: DEBUG neutron.agent.securitygroups_rpc [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Init firewall settings (driver=nsxv3) {{(pid=65106) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 536.213438] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65106) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 536.213632] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] RPC agent_id: nsxm-l-01a.corp.local [ 536.215863] env[65106]: DEBUG dogpile.cache.region [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 536.216023] env[65106]: DEBUG dogpile.lock [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 536.216098] env[65106]: DEBUG dogpile.lock [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 536.216186] env[65106]: DEBUG dogpile.lock [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 536.216280] env[65106]: DEBUG dogpile.cache.region [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 536.216369] env[65106]: DEBUG dogpile.lock [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 536.216498] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 536.249233] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Session token - acquiring [ 536.250849] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.251067] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.251110] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.251590] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.262649] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 536.553542] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 536.575473] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 536.575668] env[65106]: DEBUG dogpile.cache.region [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Cache value generated in 0.359 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 536.575785] env[65106]: DEBUG dogpile.lock [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 536.575849] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Activating Policy API Provider. [ 536.576063] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Looking for the default Infrastructure Rules. [ 536.651937] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Looking for the Default Layer3 Logged Drop Section. [ 536.667389] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 536.667856] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 536.668037] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 536.668144] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 536.668548] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 536.668890] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.184212] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 537.689311] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 538.191201] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Inventory metadata is going to be refreshed. [ 538.191577] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 539.052790] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.053036] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.053103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.053394] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.065250] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 539.066254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.067167] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 539.083811] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.084047] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.084118] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.084378] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.084503] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.084650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 539.084775] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 539.084890] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 539.117336] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.117592] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.117592] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.117910] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.118106] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.118271] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 539.138623] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.138835] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.138924] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.139209] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.139367] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.139514] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 539.159579] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.159846] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.159846] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.160153] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.160308] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.160503] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 539.160601] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 539.160701] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 539.180616] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.180898] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.180898] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.181216] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.181351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.182023] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 539.182240] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 539.182380] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 539.302874] env[65106]: DEBUG networking_nsxv3.common.locking [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 539.303415] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 539.303415] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 539.303415] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 539.303615] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.303761] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 539.303813] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 539.303913] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Inventory metadata have been refreshed. [ 539.304018] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Dryrun:True. Metadata refresh completed. [ 539.304131] env[65106]: DEBUG oslo_concurrency.lockutils [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Releasing lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 539.305941] env[65106]: INFO neutron.agent.agent_extensions_manager [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Loaded agent extensions: [] [ 539.306661] env[65106]: DEBUG neutron_lib.callbacks.manager [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65106) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 539.361548] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent RPC Daemon Started! [ 539.361698] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent loop - iteration:0 started [ 539.361793] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent out of sync with plugin! [ 544.307690] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 544.308086] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 548.310952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 548.310952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 548.310952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 548.310952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 548.310952] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 548.813949] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.308968] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 549.309165] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 549.315523] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 549.817866] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 549.817866] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 550.582318] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.582741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.582741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.582741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.594073] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 550.595100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.596056] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 550.612043] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.612265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.612265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.612446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.612530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.612641] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 550.612711] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.612779] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 550.631027] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.631232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.631232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.631414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.631573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.631688] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 550.649890] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.650082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.650127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.650289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.650390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.650535] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 550.669073] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.669243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.669289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.669449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.669550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.669664] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 550.669736] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.669804] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 550.687313] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.687507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.687507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.687695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.687780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.687884] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 550.687956] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.688036] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 550.708422] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.708635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.708635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.708826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.708930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.709057] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 550.709130] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 550.709197] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 550.709272] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 550.709372] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 550.709438] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 550.709498] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 550.709792] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 550.709856] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 550.709925] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 550.733500] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.733734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.733734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.733893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.733994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.734113] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 550.754199] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 550.754406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 550.754406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 550.754595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 550.754697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.791067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 553.985661] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b640aa42-6c3b-4cf7-ab58-eecb87f07e6b demo admin] Enqueued Resource ID: 0a9c03a7-aca5-4bcc-8cb5-594a567791af with Priority: HIGHEST for action security_group_rules [ 553.986262] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a9c03a7-aca5-4bcc-8cb5-594a567791af with Priority: HIGHEST for action security_group_rules [ 553.986559] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a9c03a7-aca5-4bcc-8cb5-594a567791af taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 553.986697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a9c03a7-aca5-4bcc-8cb5-594a567791af" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 553.986763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a9c03a7-aca5-4bcc-8cb5-594a567791af" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 553.987042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a9c03a7-aca5-4bcc-8cb5-594a567791af" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 553.987157] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a9c03a7-aca5-4bcc-8cb5-594a567791af',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.510082] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.510378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.510378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.510490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.510629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.510730] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a9c03a7-aca5-4bcc-8cb5-594a567791af already deleted. [ 554.510819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a9c03a7-aca5-4bcc-8cb5-594a567791af" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 558.987639] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 558.988056] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 563.989184] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 563.989184] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 568.990861] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 568.991245] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 573.992023] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 573.992023] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 578.993720] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 578.994056] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 579.565660] env[65106]: INFO networking_nsxv3.common.synchronization [None req-da2cf28f-318c-40d5-9e35-9268e458e014 None None] Enqueued Resource ID: 0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1 with Priority: HIGHEST for action port [ 579.568338] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1 with Priority: HIGHEST for action port [ 579.568672] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.568812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.568931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.569159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.569313] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.072883] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1 [ 580.072883] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.072883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.072883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.073483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.073483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.073483] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1 already deleted. [ 580.073483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ecd4f9c-c63f-40f9-a013-614f0b5dd1b1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.329931] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d09ad1bc-8a60-4a07-96d9-777c3a1f021f None None] Enqueued Resource ID: 08ecdeab-55e6-45ae-abc4-31e9264caa48 with Priority: HIGHEST for action port [ 581.330226] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ecdeab-55e6-45ae-abc4-31e9264caa48 with Priority: HIGHEST for action port [ 581.330757] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-08ecdeab-55e6-45ae-abc4-31e9264caa48 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.330876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08ecdeab-55e6-45ae-abc4-31e9264caa48" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.330976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08ecdeab-55e6-45ae-abc4-31e9264caa48" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.331268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08ecdeab-55e6-45ae-abc4-31e9264caa48" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.331347] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ecdeab-55e6-45ae-abc4-31e9264caa48',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.834806] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08ecdeab-55e6-45ae-abc4-31e9264caa48 [ 581.834961] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.835041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.835117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.835396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.835428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.835510] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08ecdeab-55e6-45ae-abc4-31e9264caa48 already deleted. [ 581.835591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08ecdeab-55e6-45ae-abc4-31e9264caa48" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.055785] env[65106]: INFO networking_nsxv3.common.synchronization [None req-fc4f314b-3cea-4850-ba47-4b2e72437ce1 None None] Enqueued Resource ID: 2c618b9d-78ac-4695-980a-e2f455b19a22 with Priority: HIGHEST for action port [ 582.056111] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c618b9d-78ac-4695-980a-e2f455b19a22 with Priority: HIGHEST for action port [ 582.058281] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c618b9d-78ac-4695-980a-e2f455b19a22 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.058281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c618b9d-78ac-4695-980a-e2f455b19a22" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.058281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c618b9d-78ac-4695-980a-e2f455b19a22" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.058281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c618b9d-78ac-4695-980a-e2f455b19a22" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.058281] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c618b9d-78ac-4695-980a-e2f455b19a22',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.561581] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c618b9d-78ac-4695-980a-e2f455b19a22 [ 582.561581] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.561581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.561581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.561581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.561581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.561581] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c618b9d-78ac-4695-980a-e2f455b19a22 already deleted. [ 582.561581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c618b9d-78ac-4695-980a-e2f455b19a22" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.846731] env[65106]: INFO networking_nsxv3.common.synchronization [None req-6e772a53-1a44-42d2-84ac-8513ed664699 None None] Enqueued Resource ID: 3a851771-59cb-4c99-bfd2-f8b74c267592 with Priority: HIGHEST for action port [ 582.847327] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a851771-59cb-4c99-bfd2-f8b74c267592 with Priority: HIGHEST for action port [ 582.847622] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a851771-59cb-4c99-bfd2-f8b74c267592 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.847760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a851771-59cb-4c99-bfd2-f8b74c267592" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.847823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a851771-59cb-4c99-bfd2-f8b74c267592" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.848179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a851771-59cb-4c99-bfd2-f8b74c267592" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.848292] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a851771-59cb-4c99-bfd2-f8b74c267592',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.351406] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3a851771-59cb-4c99-bfd2-f8b74c267592 [ 583.351934] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.351934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.351934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.352144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.352193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.352766] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3a851771-59cb-4c99-bfd2-f8b74c267592 already deleted. [ 583.352766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a851771-59cb-4c99-bfd2-f8b74c267592" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.704950] env[65106]: INFO networking_nsxv3.common.synchronization [None req-5962d2ff-5189-4be8-9460-209a5a577985 None None] Enqueued Resource ID: c6ab4b9e-cc6a-4080-9963-0a037d52315c with Priority: HIGHEST for action port [ 583.705324] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ab4b9e-cc6a-4080-9963-0a037d52315c with Priority: HIGHEST for action port [ 583.705814] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6ab4b9e-cc6a-4080-9963-0a037d52315c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.705941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6ab4b9e-cc6a-4080-9963-0a037d52315c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.706143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6ab4b9e-cc6a-4080-9963-0a037d52315c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.706262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6ab4b9e-cc6a-4080-9963-0a037d52315c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.706342] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ab4b9e-cc6a-4080-9963-0a037d52315c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.209061] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6ab4b9e-cc6a-4080-9963-0a037d52315c [ 584.210483] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.210732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.210732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.211131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.211233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.212382] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6ab4b9e-cc6a-4080-9963-0a037d52315c already deleted. [ 584.212495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6ab4b9e-cc6a-4080-9963-0a037d52315c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.390671] env[65106]: INFO networking_nsxv3.common.synchronization [None req-c26aabfc-e9e9-4ec0-884e-402b657d4d92 None None] Enqueued Resource ID: 2f6cbe37-045a-40f9-b365-4190e80b15c3 with Priority: HIGHEST for action port [ 584.390966] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f6cbe37-045a-40f9-b365-4190e80b15c3 with Priority: HIGHEST for action port [ 584.391609] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f6cbe37-045a-40f9-b365-4190e80b15c3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.391766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f6cbe37-045a-40f9-b365-4190e80b15c3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.391842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f6cbe37-045a-40f9-b365-4190e80b15c3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.393673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f6cbe37-045a-40f9-b365-4190e80b15c3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.393673] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f6cbe37-045a-40f9-b365-4190e80b15c3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.897073] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f6cbe37-045a-40f9-b365-4190e80b15c3 [ 584.897407] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.897483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.898352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.898352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.898352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.898352] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f6cbe37-045a-40f9-b365-4190e80b15c3 already deleted. [ 584.898352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f6cbe37-045a-40f9-b365-4190e80b15c3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.023176] env[65106]: INFO networking_nsxv3.common.synchronization [None req-50b2348d-6ee3-46fe-b342-b1a4cea74952 None None] Enqueued Resource ID: a09516ea-47c5-42f3-9175-9e8a86545ab2 with Priority: HIGHEST for action port [ 585.023301] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a09516ea-47c5-42f3-9175-9e8a86545ab2 with Priority: HIGHEST for action port [ 585.023595] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a09516ea-47c5-42f3-9175-9e8a86545ab2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.023715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a09516ea-47c5-42f3-9175-9e8a86545ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.023809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a09516ea-47c5-42f3-9175-9e8a86545ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.024322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a09516ea-47c5-42f3-9175-9e8a86545ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.025420] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a09516ea-47c5-42f3-9175-9e8a86545ab2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.526833] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a09516ea-47c5-42f3-9175-9e8a86545ab2 [ 585.527080] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.527228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.527297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.527533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.527651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.527718] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a09516ea-47c5-42f3-9175-9e8a86545ab2 already deleted. [ 585.527806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a09516ea-47c5-42f3-9175-9e8a86545ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.843220] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0bae45e5-2cae-406f-825a-58ff1a2119d6 None None] Enqueued Resource ID: 5073b890-b3e4-402e-b321-eeda8a78c393 with Priority: HIGHEST for action port [ 585.843716] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5073b890-b3e4-402e-b321-eeda8a78c393 with Priority: HIGHEST for action port [ 585.844089] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5073b890-b3e4-402e-b321-eeda8a78c393 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.844225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5073b890-b3e4-402e-b321-eeda8a78c393" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.844286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5073b890-b3e4-402e-b321-eeda8a78c393" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.844507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5073b890-b3e4-402e-b321-eeda8a78c393" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.844642] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5073b890-b3e4-402e-b321-eeda8a78c393',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.349090] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5073b890-b3e4-402e-b321-eeda8a78c393 [ 586.349359] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.349534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.349578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.349800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.349972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.349972] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5073b890-b3e4-402e-b321-eeda8a78c393 already deleted. [ 586.350133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5073b890-b3e4-402e-b321-eeda8a78c393" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.105108] env[65106]: INFO networking_nsxv3.common.synchronization [None req-02cd5732-7faa-442f-89b2-5de9f712bb5f None None] Enqueued Resource ID: a6ee5e73-4541-4d31-b06b-ac54d53086c7 with Priority: HIGHEST for action port [ 587.106442] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6ee5e73-4541-4d31-b06b-ac54d53086c7 with Priority: HIGHEST for action port [ 587.106442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6ee5e73-4541-4d31-b06b-ac54d53086c7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.106602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6ee5e73-4541-4d31-b06b-ac54d53086c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.106667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6ee5e73-4541-4d31-b06b-ac54d53086c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.107012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6ee5e73-4541-4d31-b06b-ac54d53086c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.107103] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6ee5e73-4541-4d31-b06b-ac54d53086c7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.422736] env[65106]: INFO networking_nsxv3.common.synchronization [None req-bbd6666c-77b2-45b1-a49e-8dd8fb4e2660 None None] Enqueued Resource ID: a3421e70-dc3c-49ac-a591-c15807a3b9e1 with Priority: HIGHEST for action port [ 587.422736] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a3421e70-dc3c-49ac-a591-c15807a3b9e1 with Priority: HIGHEST for action port [ 587.424535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a3421e70-dc3c-49ac-a591-c15807a3b9e1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.424535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a3421e70-dc3c-49ac-a591-c15807a3b9e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.424535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a3421e70-dc3c-49ac-a591-c15807a3b9e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.425260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a3421e70-dc3c-49ac-a591-c15807a3b9e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.425260] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a3421e70-dc3c-49ac-a591-c15807a3b9e1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.614968] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a6ee5e73-4541-4d31-b06b-ac54d53086c7 [ 587.614968] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.614968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.614968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.614968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.614968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.614968] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a6ee5e73-4541-4d31-b06b-ac54d53086c7 already deleted. [ 587.614968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6ee5e73-4541-4d31-b06b-ac54d53086c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.927198] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a3421e70-dc3c-49ac-a591-c15807a3b9e1 [ 587.927198] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.927438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.927438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.927625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.927751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.927807] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a3421e70-dc3c-49ac-a591-c15807a3b9e1 already deleted. [ 587.927879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a3421e70-dc3c-49ac-a591-c15807a3b9e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.166815] env[65106]: INFO networking_nsxv3.common.synchronization [None req-a2e914d4-e8ed-4a48-81c3-a840912da1df None None] Enqueued Resource ID: 73cbb75f-e554-4863-bb69-39d0f8ead5fe with Priority: HIGHEST for action port [ 588.167081] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cbb75f-e554-4863-bb69-39d0f8ead5fe with Priority: HIGHEST for action port [ 588.167628] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-73cbb75f-e554-4863-bb69-39d0f8ead5fe taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.167744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73cbb75f-e554-4863-bb69-39d0f8ead5fe" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.167812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73cbb75f-e554-4863-bb69-39d0f8ead5fe" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.170213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73cbb75f-e554-4863-bb69-39d0f8ead5fe" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.172399] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73cbb75f-e554-4863-bb69-39d0f8ead5fe',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.673034] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73cbb75f-e554-4863-bb69-39d0f8ead5fe [ 588.673312] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.673312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.673312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.673548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.673635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.673736] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73cbb75f-e554-4863-bb69-39d0f8ead5fe already deleted. [ 588.673820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73cbb75f-e554-4863-bb69-39d0f8ead5fe" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.072591] env[65106]: INFO networking_nsxv3.common.synchronization [None req-55c7aa5f-12df-4686-9d92-b6015c471cbd None None] Enqueued Resource ID: 4ff66791-51ce-4146-a89a-cd5df785d103 with Priority: HIGHEST for action port [ 589.073124] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff66791-51ce-4146-a89a-cd5df785d103 with Priority: HIGHEST for action port [ 589.073437] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff66791-51ce-4146-a89a-cd5df785d103 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.073561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff66791-51ce-4146-a89a-cd5df785d103" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.073627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff66791-51ce-4146-a89a-cd5df785d103" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.073873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff66791-51ce-4146-a89a-cd5df785d103" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.073952] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff66791-51ce-4146-a89a-cd5df785d103',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.577376] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ff66791-51ce-4146-a89a-cd5df785d103 [ 589.577376] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.577376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.577376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.577611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.577611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.577681] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ff66791-51ce-4146-a89a-cd5df785d103 already deleted. [ 589.577770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff66791-51ce-4146-a89a-cd5df785d103" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.358671] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0621c8aa-6009-4692-bc93-f935122127e4 None None] Enqueued Resource ID: 1626e34e-5c09-403e-b285-da50054ab201 with Priority: HIGHEST for action port [ 590.358671] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1626e34e-5c09-403e-b285-da50054ab201 with Priority: HIGHEST for action port [ 590.359717] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1626e34e-5c09-403e-b285-da50054ab201 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.360453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1626e34e-5c09-403e-b285-da50054ab201" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.360453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1626e34e-5c09-403e-b285-da50054ab201" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.362728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1626e34e-5c09-403e-b285-da50054ab201" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.362728] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1626e34e-5c09-403e-b285-da50054ab201',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.437070] env[65106]: INFO networking_nsxv3.common.synchronization [None req-f8429ae1-18fb-4769-8c71-e466a5613f83 None None] Enqueued Resource ID: a42ded76-4426-449e-9945-3adb5dab37bc with Priority: HIGHEST for action port [ 590.437675] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a42ded76-4426-449e-9945-3adb5dab37bc with Priority: HIGHEST for action port [ 590.438268] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a42ded76-4426-449e-9945-3adb5dab37bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.438268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a42ded76-4426-449e-9945-3adb5dab37bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.439414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a42ded76-4426-449e-9945-3adb5dab37bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.439639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a42ded76-4426-449e-9945-3adb5dab37bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.439728] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a42ded76-4426-449e-9945-3adb5dab37bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.864918] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1626e34e-5c09-403e-b285-da50054ab201 [ 590.865176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.865339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.865403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.865625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.865714] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.865809] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1626e34e-5c09-403e-b285-da50054ab201 already deleted. [ 590.865891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1626e34e-5c09-403e-b285-da50054ab201" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.944426] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a42ded76-4426-449e-9945-3adb5dab37bc [ 590.944665] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.944811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.944918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.945295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.945295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.945390] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a42ded76-4426-449e-9945-3adb5dab37bc already deleted. [ 590.945390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a42ded76-4426-449e-9945-3adb5dab37bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.466429] env[65106]: INFO networking_nsxv3.common.synchronization [None req-95898ab8-4145-41b2-a542-f0f6689a5f6d None None] Enqueued Resource ID: ee31f064-bb8d-4f17-827d-495efc2ee774 with Priority: HIGHEST for action port [ 591.467167] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee31f064-bb8d-4f17-827d-495efc2ee774 with Priority: HIGHEST for action port [ 591.467340] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee31f064-bb8d-4f17-827d-495efc2ee774 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.467503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee31f064-bb8d-4f17-827d-495efc2ee774" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.467564] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee31f064-bb8d-4f17-827d-495efc2ee774" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.467812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee31f064-bb8d-4f17-827d-495efc2ee774" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.469200] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee31f064-bb8d-4f17-827d-495efc2ee774',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.975219] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee31f064-bb8d-4f17-827d-495efc2ee774 [ 591.975501] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.975609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.975715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.975893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.976020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.976093] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee31f064-bb8d-4f17-827d-495efc2ee774 already deleted. [ 591.976166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee31f064-bb8d-4f17-827d-495efc2ee774" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.192140] env[65106]: INFO networking_nsxv3.common.synchronization [None req-6b8c227a-e832-45d4-840c-5b706ffa9849 None None] Enqueued Resource ID: 56c9882c-0123-4cf1-8df8-0c243d67d3a3 with Priority: HIGHEST for action port [ 592.192414] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56c9882c-0123-4cf1-8df8-0c243d67d3a3 with Priority: HIGHEST for action port [ 592.192974] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-56c9882c-0123-4cf1-8df8-0c243d67d3a3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.193111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56c9882c-0123-4cf1-8df8-0c243d67d3a3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.193181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56c9882c-0123-4cf1-8df8-0c243d67d3a3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.193429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56c9882c-0123-4cf1-8df8-0c243d67d3a3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.193508] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56c9882c-0123-4cf1-8df8-0c243d67d3a3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.440332] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d7301893-5614-478e-a1d7-32508f0d10c2 None None] Enqueued Resource ID: 97b74306-dbe6-40af-8f8e-c7d4ac3a41cd with Priority: HIGHEST for action port [ 592.440332] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97b74306-dbe6-40af-8f8e-c7d4ac3a41cd with Priority: HIGHEST for action port [ 592.440427] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-97b74306-dbe6-40af-8f8e-c7d4ac3a41cd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.440544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97b74306-dbe6-40af-8f8e-c7d4ac3a41cd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.440600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97b74306-dbe6-40af-8f8e-c7d4ac3a41cd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.440854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97b74306-dbe6-40af-8f8e-c7d4ac3a41cd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.440934] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97b74306-dbe6-40af-8f8e-c7d4ac3a41cd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.695621] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56c9882c-0123-4cf1-8df8-0c243d67d3a3 [ 592.695939] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.696018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.696119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.696390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.696497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.696610] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56c9882c-0123-4cf1-8df8-0c243d67d3a3 already deleted. [ 592.696703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56c9882c-0123-4cf1-8df8-0c243d67d3a3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.945544] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 97b74306-dbe6-40af-8f8e-c7d4ac3a41cd [ 592.945838] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.946753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.946852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.947093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.947196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.947288] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:97b74306-dbe6-40af-8f8e-c7d4ac3a41cd already deleted. [ 592.947371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97b74306-dbe6-40af-8f8e-c7d4ac3a41cd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.502723] env[65106]: INFO networking_nsxv3.common.synchronization [None req-08b8cef2-00a0-4bed-a598-dc3a1852a86d None None] Enqueued Resource ID: c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc with Priority: HIGHEST for action port [ 594.503285] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc with Priority: HIGHEST for action port [ 594.503560] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.503680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.503744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.504831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.506145] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.576029] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ef0f6b0c-50a0-487c-bf3b-21bc28e8e0e4 None None] Enqueued Resource ID: 6af8c59c-9870-4b7a-9e0a-0748557b9a13 with Priority: HIGHEST for action port [ 594.576871] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6af8c59c-9870-4b7a-9e0a-0748557b9a13 with Priority: HIGHEST for action port [ 594.578295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6af8c59c-9870-4b7a-9e0a-0748557b9a13 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.578295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6af8c59c-9870-4b7a-9e0a-0748557b9a13" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.578295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6af8c59c-9870-4b7a-9e0a-0748557b9a13" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.578295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6af8c59c-9870-4b7a-9e0a-0748557b9a13" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.579606] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6af8c59c-9870-4b7a-9e0a-0748557b9a13',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.009099] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc [ 595.009296] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.009434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.009503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.009809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.009809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.009916] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc already deleted. [ 595.009947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8eb9a8b-f146-4a0e-9d5a-88fce3bfb3cc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.082593] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6af8c59c-9870-4b7a-9e0a-0748557b9a13 [ 595.082811] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.082937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.083018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.083251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.083372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.083446] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6af8c59c-9870-4b7a-9e0a-0748557b9a13 already deleted. [ 595.083507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6af8c59c-9870-4b7a-9e0a-0748557b9a13" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.135606] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0fe35206-a9b9-4e1a-821b-a52cfea86a5e None None] Enqueued Resource ID: dd036dda-5d55-475a-820a-7ebb691c8aa6 with Priority: HIGHEST for action port [ 595.136962] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd036dda-5d55-475a-820a-7ebb691c8aa6 with Priority: HIGHEST for action port [ 595.137329] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd036dda-5d55-475a-820a-7ebb691c8aa6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.137461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd036dda-5d55-475a-820a-7ebb691c8aa6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.137629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd036dda-5d55-475a-820a-7ebb691c8aa6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.137774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd036dda-5d55-475a-820a-7ebb691c8aa6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.137852] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd036dda-5d55-475a-820a-7ebb691c8aa6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.412719] env[65106]: INFO networking_nsxv3.common.synchronization [req-fa8c5b3e-c66e-4121-81d2-41a6c6f6b749 req-d3fe94b8-8dff-45c7-ba59-8df6c441fd6e tempest-SecurityGroupRulesNegativeTestJSON-309893964 tempest-SecurityGroupRulesNegativeTestJSON-309893964-project-member] Enqueued Resource ID: 6a95e930-07fc-49f8-882b-74378ed96654 with Priority: HIGHEST for action security_group_rules [ 595.413357] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a95e930-07fc-49f8-882b-74378ed96654 with Priority: HIGHEST for action security_group_rules [ 595.413654] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a95e930-07fc-49f8-882b-74378ed96654 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.413772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a95e930-07fc-49f8-882b-74378ed96654" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.413838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a95e930-07fc-49f8-882b-74378ed96654" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.414361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a95e930-07fc-49f8-882b-74378ed96654" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.414573] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a95e930-07fc-49f8-882b-74378ed96654',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.419040] env[65106]: INFO networking_nsxv3.common.synchronization [None req-04097193-4ae1-4e88-af66-c4b27f0fb95a None None] Enqueued Resource ID: a79bde41-1b10-47c3-871d-c70a44452f46 with Priority: HIGHEST for action port [ 595.419244] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a79bde41-1b10-47c3-871d-c70a44452f46 with Priority: HIGHEST for action port [ 595.419721] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a79bde41-1b10-47c3-871d-c70a44452f46 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.419827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a79bde41-1b10-47c3-871d-c70a44452f46" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.419886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a79bde41-1b10-47c3-871d-c70a44452f46" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.420659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a79bde41-1b10-47c3-871d-c70a44452f46" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.420659] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a79bde41-1b10-47c3-871d-c70a44452f46',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.642449] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd036dda-5d55-475a-820a-7ebb691c8aa6 [ 595.642713] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.642835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.642909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.643153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.643292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.643292] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd036dda-5d55-475a-820a-7ebb691c8aa6 already deleted. [ 595.643391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd036dda-5d55-475a-820a-7ebb691c8aa6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.922328] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a79bde41-1b10-47c3-871d-c70a44452f46 [ 595.922802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.922965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.924319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.924629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.924727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.924843] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a79bde41-1b10-47c3-871d-c70a44452f46 already deleted. [ 595.924952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a79bde41-1b10-47c3-871d-c70a44452f46" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.944273] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.944614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.944614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.944941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.945129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.945253] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a95e930-07fc-49f8-882b-74378ed96654 already deleted. [ 595.945360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a95e930-07fc-49f8-882b-74378ed96654" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.886102] env[65106]: INFO networking_nsxv3.common.synchronization [req-62995264-00d2-42fb-b9a2-3958307c009a req-fc3db976-73ae-4543-9982-1a78fb642f62 tempest-ServerDiagnosticsNegativeTest-374208017 tempest-ServerDiagnosticsNegativeTest-374208017-project-member] Enqueued Resource ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 with Priority: HIGHEST for action security_group_members [ 597.886340] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 with Priority: HIGHEST for action security_group_members [ 597.887312] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.887312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.887312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.887312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.887312] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.887312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.887623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.887623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.887739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.887837] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.973653] env[65106]: INFO networking_nsxv3.common.synchronization [None req-832654f5-07dd-403e-8206-451a5d4e3ef8 None None] Enqueued Resource ID: 2e98ea02-3fad-4f7d-803f-663f0de5115f with Priority: HIGHEST for action port [ 597.975753] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e98ea02-3fad-4f7d-803f-663f0de5115f with Priority: HIGHEST for action port [ 597.976036] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e98ea02-3fad-4f7d-803f-663f0de5115f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.976227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e98ea02-3fad-4f7d-803f-663f0de5115f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.976314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e98ea02-3fad-4f7d-803f-663f0de5115f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.976615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e98ea02-3fad-4f7d-803f-663f0de5115f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.976715] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e98ea02-3fad-4f7d-803f-663f0de5115f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.389924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.390105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.390181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.390386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.390514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.390714] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.390867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.390867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.391060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.391188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.391271] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 already deleted. [ 598.391312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.413262] env[65106]: INFO networking_nsxv3.common.synchronization [None req-c0390703-a906-40c2-98b2-91648b9d9d8a None None] Enqueued Resource ID: 836dc9bf-1437-49ed-a3b1-bfb7c9225602 with Priority: HIGHEST for action port [ 598.413262] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 836dc9bf-1437-49ed-a3b1-bfb7c9225602 with Priority: HIGHEST for action port [ 598.413794] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-836dc9bf-1437-49ed-a3b1-bfb7c9225602 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.413918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-836dc9bf-1437-49ed-a3b1-bfb7c9225602" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.413918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-836dc9bf-1437-49ed-a3b1-bfb7c9225602" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.414476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-836dc9bf-1437-49ed-a3b1-bfb7c9225602" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.414476] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('836dc9bf-1437-49ed-a3b1-bfb7c9225602',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.480132] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e98ea02-3fad-4f7d-803f-663f0de5115f [ 598.480341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.480474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.480541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.480749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.480838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.480945] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e98ea02-3fad-4f7d-803f-663f0de5115f already deleted. [ 598.481171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e98ea02-3fad-4f7d-803f-663f0de5115f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.574338] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.574537] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.574661] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.575257] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.575536] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.575697] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.575920] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.576218] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.576218] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.576623] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.576623] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.576679] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.576772] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.576867] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.576973] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.577120] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.597836] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.597994] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.598148] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.598320] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.598728] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-c520fbb9-f424-49fc-a3b8-18494df8f720 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.598881] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-c520fbb9-f424-49fc-a3b8-18494df8f720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.598881] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-c520fbb9-f424-49fc-a3b8-18494df8f720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.599328] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-c520fbb9-f424-49fc-a3b8-18494df8f720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.599396] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c520fbb9-f424-49fc-a3b8-18494df8f720',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.918716] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 836dc9bf-1437-49ed-a3b1-bfb7c9225602 [ 598.919036] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.919153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.919225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.919430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.919516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.919605] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:836dc9bf-1437-49ed-a3b1-bfb7c9225602 already deleted. [ 598.921084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-836dc9bf-1437-49ed-a3b1-bfb7c9225602" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.104852] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.104852] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.104852] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.106350] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.108172] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.108172] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port c520fbb9-f424-49fc-a3b8-18494df8f720 not found, creating... [ 599.108172] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.108172] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.108172] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.108172] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.108172] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.109092] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.109216] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.109339] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.109562] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.109853] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.110033] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: c520fbb9-f424-49fc-a3b8-18494df8f720 is going to be created. [ 599.148370] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.148620] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.148741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.150413] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.150413] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.151021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-c520fbb9-f424-49fc-a3b8-18494df8f720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.785827] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ca462679-c84c-4204-bfae-c60e1eb406b0 None None] Enqueued Resource ID: e7d2bdf7-303a-447e-a4a6-41efc2ca28de with Priority: HIGHEST for action port [ 599.786823] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7d2bdf7-303a-447e-a4a6-41efc2ca28de with Priority: HIGHEST for action port [ 599.787705] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7d2bdf7-303a-447e-a4a6-41efc2ca28de taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.787705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7d2bdf7-303a-447e-a4a6-41efc2ca28de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.787705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7d2bdf7-303a-447e-a4a6-41efc2ca28de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.787705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7d2bdf7-303a-447e-a4a6-41efc2ca28de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.787932] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7d2bdf7-303a-447e-a4a6-41efc2ca28de',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.976175] env[65106]: INFO networking_nsxv3.common.synchronization [req-62995264-00d2-42fb-b9a2-3958307c009a req-a4c2b8bf-356c-4897-b5dd-49c85030c734 service nova] Enqueued Resource ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 with Priority: HIGHEST for action security_group_rules [ 599.976654] env[65106]: INFO networking_nsxv3.common.synchronization [req-62995264-00d2-42fb-b9a2-3958307c009a req-a4c2b8bf-356c-4897-b5dd-49c85030c734 service nova] Enqueued Resource ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 with Priority: HIGHEST for action security_group_members [ 599.976654] env[65106]: INFO networking_nsxv3.common.synchronization [req-62995264-00d2-42fb-b9a2-3958307c009a req-a4c2b8bf-356c-4897-b5dd-49c85030c734 service nova] Enqueued Resource ID: c520fbb9-f424-49fc-a3b8-18494df8f720 with Priority: HIGHEST for action port [ 599.976912] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 with Priority: HIGHEST for action security_group_rules [ 599.977217] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 with Priority: HIGHEST for action security_group_members [ 599.977332] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c520fbb9-f424-49fc-a3b8-18494df8f720 with Priority: HIGHEST for action port [ 599.977607] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.977747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.977812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.978100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.978244] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.979674] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.979925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.979925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.980034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.980192] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.980321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.980406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.980855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.980952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.981080] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.982936] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-c520fbb9-f424-49fc-a3b8-18494df8f720 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.982936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c520fbb9-f424-49fc-a3b8-18494df8f720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.982936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c520fbb9-f424-49fc-a3b8-18494df8f720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.982936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c520fbb9-f424-49fc-a3b8-18494df8f720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.982936] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c520fbb9-f424-49fc-a3b8-18494df8f720',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.291546] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7d2bdf7-303a-447e-a4a6-41efc2ca28de [ 600.291740] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.291825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.291876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.292097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.292211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.292313] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7d2bdf7-303a-447e-a4a6-41efc2ca28de already deleted. [ 600.292389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7d2bdf7-303a-447e-a4a6-41efc2ca28de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.480949] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.481689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.483222] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.490306] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c520fbb9-f424-49fc-a3b8-18494df8f720 with status ACTIVE [ 600.490555] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.490689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.490748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.490956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.491055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.491262] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.491363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.491425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.491584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.491639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.491803] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.491894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.491954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.492103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.492176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.492277] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c520fbb9-f424-49fc-a3b8-18494df8f720 is going to be updated. [ 600.517923] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.518143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.518178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.518372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.518508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.518670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c520fbb9-f424-49fc-a3b8-18494df8f720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.728193] env[65106]: INFO networking_nsxv3.common.synchronization [req-3b47c02e-a392-4276-8350-eedc17b29bed req-8ee34d06-8b1b-4bf7-a069-b1e3e74bbb25 tempest-TenantUsagesTestJSON-1694669173 tempest-TenantUsagesTestJSON-1694669173-project-member] Enqueued Resource ID: 1c844632-55aa-48db-8ca5-f00fe2244035 with Priority: HIGHEST for action security_group_members [ 600.728754] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c844632-55aa-48db-8ca5-f00fe2244035 with Priority: HIGHEST for action security_group_members [ 600.729542] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c844632-55aa-48db-8ca5-f00fe2244035 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.729726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.729863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.730168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.730743] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.730915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.731025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.731299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.731422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.731821] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c844632-55aa-48db-8ca5-f00fe2244035',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.986484] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.235607] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.235761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.235831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.236067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.236157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.236347] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.236451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.236495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.236645] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.236718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.237828] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c844632-55aa-48db-8ca5-f00fe2244035 already deleted. [ 601.237959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.347934] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.347934] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.347934] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.347934] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.347934] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.347934] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.348359] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.348359] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.348359] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.348496] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.348599] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.348698] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.348796] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.348892] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.348988] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.351959] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.372770] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.372770] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.372770] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.372770] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.372943] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-3b6810a6-a739-47f6-b33f-0cc5a029bc50 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.373110] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-3b6810a6-a739-47f6-b33f-0cc5a029bc50" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.373217] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-3b6810a6-a739-47f6-b33f-0cc5a029bc50" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.373576] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-3b6810a6-a739-47f6-b33f-0cc5a029bc50" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.373773] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b6810a6-a739-47f6-b33f-0cc5a029bc50',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.490679] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.490868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.490914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.491139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.491251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.491349] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 is going to be created. [ 601.548862] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.549504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.549504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.549504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.549504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.563763] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 in Status: UNINITIALIZED for 2s [ 601.788899] env[65106]: INFO networking_nsxv3.common.synchronization [None req-52918521-4032-4ca3-a375-35ab91abc77e tempest-VolumesAssistedSnapshotsTest-469682830 tempest-VolumesAssistedSnapshotsTest-469682830-project-member] Enqueued Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_rules [ 601.790031] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_rules [ 601.790031] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.790031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.790031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.791073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.791073] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.877012] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.877528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.877528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.877832] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.877832] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.878879] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 3b6810a6-a739-47f6-b33f-0cc5a029bc50 not found, creating... [ 601.878879] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.878879] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.878879] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.878879] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.878879] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.879293] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.879293] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.879293] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.880495] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.880495] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.880495] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 3b6810a6-a739-47f6-b33f-0cc5a029bc50 is going to be created. [ 601.902956] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.903165] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.903279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.903544] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.903763] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.903966] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-3b6810a6-a739-47f6-b33f-0cc5a029bc50" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.271124] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0ab9a070-263e-4933-9f7b-ec97a75d0711 None None] Enqueued Resource ID: d35243b6-b1fa-4db3-993d-6112f6f62244 with Priority: HIGHEST for action port [ 602.271124] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d35243b6-b1fa-4db3-993d-6112f6f62244 with Priority: HIGHEST for action port [ 602.271469] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d35243b6-b1fa-4db3-993d-6112f6f62244 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.271667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d35243b6-b1fa-4db3-993d-6112f6f62244" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.271739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d35243b6-b1fa-4db3-993d-6112f6f62244" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.271982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d35243b6-b1fa-4db3-993d-6112f6f62244" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.272078] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d35243b6-b1fa-4db3-993d-6112f6f62244',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.314367] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.314367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.314367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.314819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.314819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.314819] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 already deleted. [ 602.314907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.442878] env[65106]: INFO networking_nsxv3.common.synchronization [None req-913228a2-4d0d-44ee-8637-b6a57ad874f8 None None] Enqueued Resource ID: f5fc0f58-fb74-4dcb-b4fb-057942478ab5 with Priority: HIGHEST for action port [ 602.445411] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5fc0f58-fb74-4dcb-b4fb-057942478ab5 with Priority: HIGHEST for action port [ 602.446115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5fc0f58-fb74-4dcb-b4fb-057942478ab5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.446115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5fc0f58-fb74-4dcb-b4fb-057942478ab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.446115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5fc0f58-fb74-4dcb-b4fb-057942478ab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.447898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5fc0f58-fb74-4dcb-b4fb-057942478ab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.447898] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5fc0f58-fb74-4dcb-b4fb-057942478ab5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.600261] env[65106]: INFO networking_nsxv3.common.synchronization [req-3b47c02e-a392-4276-8350-eedc17b29bed req-e2b43da1-9070-464c-8597-f4a241176bc9 service nova] Enqueued Resource ID: 1c844632-55aa-48db-8ca5-f00fe2244035 with Priority: HIGHEST for action security_group_rules [ 602.602136] env[65106]: INFO networking_nsxv3.common.synchronization [req-3b47c02e-a392-4276-8350-eedc17b29bed req-e2b43da1-9070-464c-8597-f4a241176bc9 service nova] Enqueued Resource ID: 1c844632-55aa-48db-8ca5-f00fe2244035 with Priority: HIGHEST for action security_group_members [ 602.603302] env[65106]: INFO networking_nsxv3.common.synchronization [req-3b47c02e-a392-4276-8350-eedc17b29bed req-e2b43da1-9070-464c-8597-f4a241176bc9 service nova] Enqueued Resource ID: 3b6810a6-a739-47f6-b33f-0cc5a029bc50 with Priority: HIGHEST for action port [ 602.603856] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c844632-55aa-48db-8ca5-f00fe2244035 with Priority: HIGHEST for action security_group_rules [ 602.606024] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c844632-55aa-48db-8ca5-f00fe2244035 with Priority: HIGHEST for action security_group_members [ 602.606153] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b6810a6-a739-47f6-b33f-0cc5a029bc50 with Priority: HIGHEST for action port [ 602.606707] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c844632-55aa-48db-8ca5-f00fe2244035 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.607286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.607286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.607286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.607286] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c844632-55aa-48db-8ca5-f00fe2244035',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.608050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c844632-55aa-48db-8ca5-f00fe2244035 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.608932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.608932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.608932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.608932] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.608932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.608932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.608932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.608932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.609253] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c844632-55aa-48db-8ca5-f00fe2244035',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.610927] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b6810a6-a739-47f6-b33f-0cc5a029bc50 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.611130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b6810a6-a739-47f6-b33f-0cc5a029bc50" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.611959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b6810a6-a739-47f6-b33f-0cc5a029bc50" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.611959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b6810a6-a739-47f6-b33f-0cc5a029bc50" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.611959] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b6810a6-a739-47f6-b33f-0cc5a029bc50',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.730168] env[65106]: INFO networking_nsxv3.common.synchronization [None req-08c544a2-15af-45bf-8180-bfc0e5c364ea tempest-VolumesAssistedSnapshotsTest-469682830 tempest-VolumesAssistedSnapshotsTest-469682830-project-member] Enqueued Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_rules [ 602.730698] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_rules [ 602.730989] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.731124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.731226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.731516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.731516] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.774383] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d35243b6-b1fa-4db3-993d-6112f6f62244 [ 602.774617] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.775022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.775022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.775137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.775206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.775251] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d35243b6-b1fa-4db3-993d-6112f6f62244 already deleted. [ 602.775364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d35243b6-b1fa-4db3-993d-6112f6f62244" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.951662] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5fc0f58-fb74-4dcb-b4fb-057942478ab5 [ 602.951662] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.951662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.951662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.951662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.951662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.951662] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5fc0f58-fb74-4dcb-b4fb-057942478ab5 already deleted. [ 602.951662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5fc0f58-fb74-4dcb-b4fb-057942478ab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.974497] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d7b65564-55ff-46e4-a13f-ea127c2210d0 None None] Enqueued Resource ID: 6a78bfe5-5146-4e53-a427-949c6cf168b9 with Priority: HIGHEST for action port [ 602.976137] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a78bfe5-5146-4e53-a427-949c6cf168b9 with Priority: HIGHEST for action port [ 602.976137] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a78bfe5-5146-4e53-a427-949c6cf168b9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.976137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a78bfe5-5146-4e53-a427-949c6cf168b9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.976137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a78bfe5-5146-4e53-a427-949c6cf168b9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.976137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a78bfe5-5146-4e53-a427-949c6cf168b9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.976613] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a78bfe5-5146-4e53-a427-949c6cf168b9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.115371] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c844632-55aa-48db-8ca5-f00fe2244035 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.115371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.122434] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b6810a6-a739-47f6-b33f-0cc5a029bc50 with status ACTIVE [ 603.122615] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.122746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.122809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.123026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.123134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.123328] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.123419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.124360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.124360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.124360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.124360] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.124360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.124360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.124360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.124360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.124360] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b6810a6-a739-47f6-b33f-0cc5a029bc50 is going to be updated. [ 603.125523] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c844632-55aa-48db-8ca5-f00fe2244035',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.153106] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.153106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.153106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.153106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.153106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.153410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b6810a6-a739-47f6-b33f-0cc5a029bc50" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.259407] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.259559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.259665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.259844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.259934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.262517] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 already deleted. [ 603.262517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.432553] env[65106]: INFO networking_nsxv3.common.synchronization [req-4b7d62b3-87e7-4fd4-990e-2515603402c0 req-0e6d415a-1d8c-4dbc-b58c-b1e368d3bdd1 tempest-DeleteServersAdminTestJSON-453191217 tempest-DeleteServersAdminTestJSON-453191217-project-member] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 603.433173] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 603.435399] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.435399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.435399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.435399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.435399] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.435692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.435692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.435861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.435987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.436063] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.478645] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a78bfe5-5146-4e53-a427-949c6cf168b9 [ 603.478770] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.478914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.479019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.479318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.479403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.479502] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a78bfe5-5146-4e53-a427-949c6cf168b9 already deleted. [ 603.479581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a78bfe5-5146-4e53-a427-949c6cf168b9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.502648] env[65106]: INFO networking_nsxv3.common.synchronization [req-52d46073-c66a-43d5-ad76-459510fc2722 req-f966c843-e42a-4451-93b7-3dfa437030e9 tempest-SecurityGroupRulesNegativeTestJSON-309893964 tempest-SecurityGroupRulesNegativeTestJSON-309893964-project-member] Enqueued Resource ID: 6a95e930-07fc-49f8-882b-74378ed96654 with Priority: HIGHEST for action security_group_rules [ 603.503511] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a95e930-07fc-49f8-882b-74378ed96654 with Priority: HIGHEST for action security_group_rules [ 603.503813] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a95e930-07fc-49f8-882b-74378ed96654 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.503931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a95e930-07fc-49f8-882b-74378ed96654" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.504010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a95e930-07fc-49f8-882b-74378ed96654" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.504543] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a95e930-07fc-49f8-882b-74378ed96654" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.504655] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a95e930-07fc-49f8-882b-74378ed96654',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.573035] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 in Status: SUCCESS [ 603.573292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.574782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.574782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.574782] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.574782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.574782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.574782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.574782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.574782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.574782] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.631677] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c844632-55aa-48db-8ca5-f00fe2244035',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.741444] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.741444] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.741444] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.741816] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.742242] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.742558] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.742937] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.743307] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.743860] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.744322] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.744571] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.744863] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.745647] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.745647] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.745647] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.745647] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.770205] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.770205] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.770205] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.770205] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.770205] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-82c017bd-c868-4bd1-bd8b-a4593d034ba0 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.770205] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-82c017bd-c868-4bd1-bd8b-a4593d034ba0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.770205] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-82c017bd-c868-4bd1-bd8b-a4593d034ba0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.771329] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-82c017bd-c868-4bd1-bd8b-a4593d034ba0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.772902] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c017bd-c868-4bd1-bd8b-a4593d034ba0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.938535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.938777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.939074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.939074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.939231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.939394] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.939575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.939575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.939738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.939809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.940240] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 already deleted. [ 603.940240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.024750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.026074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.026074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.026074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.026074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.026074] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a95e930-07fc-49f8-882b-74378ed96654 already deleted. [ 604.026074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a95e930-07fc-49f8-882b-74378ed96654" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.080783] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.081135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.081349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.081655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.081923] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.082152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.082297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.082541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.082718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.082885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.083137] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.084961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.084961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.084961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.084961] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.084961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.084961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.084961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.084961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.084961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.084961] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.134864] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.135151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.135273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.135629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.135862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.135968] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c844632-55aa-48db-8ca5-f00fe2244035 is going to be created. [ 604.161700] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.161700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.161700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.162021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.162130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.173139] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c844632-55aa-48db-8ca5-f00fe2244035 in Status: UNINITIALIZED for 2s [ 604.276996] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.277301] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.277471] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.277786] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.277957] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.278218] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 82c017bd-c868-4bd1-bd8b-a4593d034ba0 not found, creating... [ 604.278983] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.278983] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.278983] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.278983] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.279177] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.279460] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.279647] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.279760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.279998] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.280172] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.280311] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 82c017bd-c868-4bd1-bd8b-a4593d034ba0 is going to be created. [ 604.316762] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.316762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.316762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.316762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.316762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.316762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-82c017bd-c868-4bd1-bd8b-a4593d034ba0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.588663] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9: rpc.has_security_group_logging(os_id): False [ 604.608760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.608760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.608760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.608760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.609574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.609574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.609574] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.609574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.609574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.609574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.609574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.609574] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 is going to be created. [ 604.686753] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.686902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.686966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.687221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.687402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.701957] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 in Status: IN_PROGRESS for 2s [ 604.834193] env[65106]: INFO networking_nsxv3.common.synchronization [req-01724ce6-5b1d-43f8-9419-0122d09561a0 req-8587e45b-4420-45ac-8f83-895bdaad4fab tempest-ServerTagsTestJSON-133426062 tempest-ServerTagsTestJSON-133426062-project-member] Enqueued Resource ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 with Priority: HIGHEST for action security_group_members [ 604.834876] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 with Priority: HIGHEST for action security_group_members [ 604.835193] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e524fc2-f045-49dd-9b9d-694845e21af8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.836135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.836135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.836135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.836311] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.836861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.836999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.837244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.837343] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.837447] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e524fc2-f045-49dd-9b9d-694845e21af8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.097190] env[65106]: INFO networking_nsxv3.common.synchronization [req-4b7d62b3-87e7-4fd4-990e-2515603402c0 req-03104848-23df-42a3-bb1f-50804692bb91 service nova] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_rules [ 605.097352] env[65106]: INFO networking_nsxv3.common.synchronization [req-4b7d62b3-87e7-4fd4-990e-2515603402c0 req-03104848-23df-42a3-bb1f-50804692bb91 service nova] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 605.097478] env[65106]: INFO networking_nsxv3.common.synchronization [req-4b7d62b3-87e7-4fd4-990e-2515603402c0 req-03104848-23df-42a3-bb1f-50804692bb91 service nova] Enqueued Resource ID: 82c017bd-c868-4bd1-bd8b-a4593d034ba0 with Priority: HIGHEST for action port [ 605.098082] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_rules [ 605.098227] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 605.098322] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82c017bd-c868-4bd1-bd8b-a4593d034ba0 with Priority: HIGHEST for action port [ 605.098829] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.099129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.099306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.100333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.100333] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.101742] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.101836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.101836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.102117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.102859] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.102859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.102859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.102859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.102859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.103144] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.104165] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-82c017bd-c868-4bd1-bd8b-a4593d034ba0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.104165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82c017bd-c868-4bd1-bd8b-a4593d034ba0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.104165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82c017bd-c868-4bd1-bd8b-a4593d034ba0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.104333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82c017bd-c868-4bd1-bd8b-a4593d034ba0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.104390] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82c017bd-c868-4bd1-bd8b-a4593d034ba0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.283951] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b20dfddf-3278-4d72-bd2d-33da1302861c None None] Enqueued Resource ID: a7a9d616-2926-4fcd-a5b5-929a008b777a with Priority: HIGHEST for action port [ 605.283951] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a7a9d616-2926-4fcd-a5b5-929a008b777a with Priority: HIGHEST for action port [ 605.284385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a7a9d616-2926-4fcd-a5b5-929a008b777a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.284385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a7a9d616-2926-4fcd-a5b5-929a008b777a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.284483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a7a9d616-2926-4fcd-a5b5-929a008b777a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.285737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a7a9d616-2926-4fcd-a5b5-929a008b777a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.285737] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a7a9d616-2926-4fcd-a5b5-929a008b777a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.340781] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.340944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.341024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.341297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.341411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.341599] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.341698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.341761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.341910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.341983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.342104] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 already deleted. [ 605.342189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.379073] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-511 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.379073] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-511" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.379073] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-511" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.379073] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-511" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.379073] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.379073] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.379073] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.379073] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.379520] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.379520] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.379520] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 605.379520] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 605.379882] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 605.380090] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 605.380228] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 605.380382] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 605.403774] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 605.403774] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 605.403774] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 605.403774] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-511" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.404677] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-5d0719ef-eee3-4adb-82c4-1bc98b49e032 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.405811] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-5d0719ef-eee3-4adb-82c4-1bc98b49e032" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.405811] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-5d0719ef-eee3-4adb-82c4-1bc98b49e032" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.405811] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-5d0719ef-eee3-4adb-82c4-1bc98b49e032" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.405811] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d0719ef-eee3-4adb-82c4-1bc98b49e032',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.450797] env[65106]: INFO networking_nsxv3.common.synchronization [None req-4e5bc646-fa5c-434f-a5df-982a924dd4e8 tempest-ServersTestBootFromVolume-1396593016 tempest-ServersTestBootFromVolume-1396593016-project-member] Enqueued Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_rules [ 605.451436] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_rules [ 605.451702] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6947545-c4e6-4692-9dfa-c1bdd403650c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.451848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.451914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.452363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.453079] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.606073] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.606431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.606431] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.607300] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82c017bd-c868-4bd1-bd8b-a4593d034ba0 with status ACTIVE [ 605.607938] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.608077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.608217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.608534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.608534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.608699] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.608814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.608864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.609027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.609230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.609418] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.609512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.609567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.609709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.609778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.609858] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82c017bd-c868-4bd1-bd8b-a4593d034ba0 is going to be updated. [ 605.635136] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.635136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.635136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.635136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.635136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.635504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82c017bd-c868-4bd1-bd8b-a4593d034ba0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.676561] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ad14dd95-0429-4b0f-a509-344303de48db tempest-ServersTestBootFromVolume-1396593016 tempest-ServersTestBootFromVolume-1396593016-project-member] Enqueued Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_rules [ 605.676899] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_rules [ 605.677287] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6947545-c4e6-4692-9dfa-c1bdd403650c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.677387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.786708] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a7a9d616-2926-4fcd-a5b5-929a008b777a [ 605.787035] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.787199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.787294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.787555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.787652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.787748] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a7a9d616-2926-4fcd-a5b5-929a008b777a already deleted. [ 605.787829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a7a9d616-2926-4fcd-a5b5-929a008b777a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.908799] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.908799] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.908799] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.909122] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.910622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.910622] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 5d0719ef-eee3-4adb-82c4-1bc98b49e032 not found, creating... [ 605.910622] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.910622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.910622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.910622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.910622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.911134] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.911134] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.911134] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.911390] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.911390] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.911472] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 5d0719ef-eee3-4adb-82c4-1bc98b49e032 is going to be created. [ 605.936086] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.936086] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.936086] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.936350] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.936524] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.937171] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-5d0719ef-eee3-4adb-82c4-1bc98b49e032" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.973412] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.973412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.973412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.974065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.974065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.974065] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6947545-c4e6-4692-9dfa-c1bdd403650c already deleted. [ 605.974065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.974065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.974254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.974292] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.113219] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.185752] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c844632-55aa-48db-8ca5-f00fe2244035 in Status: SUCCESS [ 606.185752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.185752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.185752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.185752] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.185752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.185752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.185752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.185752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.185752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.185752] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c844632-55aa-48db-8ca5-f00fe2244035',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.495089] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.495307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.495307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.495669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.495770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.495858] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6947545-c4e6-4692-9dfa-c1bdd403650c already deleted. [ 606.495940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.614732] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.615143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.615143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.615263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.615263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.615351] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 is going to be created. [ 606.641315] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.641701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.641836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.642016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.642189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.652605] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: UNINITIALIZED for 2s [ 606.689796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c844632-55aa-48db-8ca5-f00fe2244035 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.689959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.690030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.690268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.690436] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.690563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.690598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.690736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.690823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.690912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.691064] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c844632-55aa-48db-8ca5-f00fe2244035 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.691158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.691265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.691417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.691554] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.691644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.691704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.691838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.691910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.691988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.692088] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c844632-55aa-48db-8ca5-f00fe2244035',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.716772] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 in Status: SUCCESS [ 606.719039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.742533] env[65106]: INFO networking_nsxv3.common.synchronization [req-01724ce6-5b1d-43f8-9419-0122d09561a0 req-28974d67-a1dc-4fa2-961d-18ff121a86c0 service nova] Enqueued Resource ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 with Priority: HIGHEST for action security_group_rules [ 606.742721] env[65106]: INFO networking_nsxv3.common.synchronization [req-01724ce6-5b1d-43f8-9419-0122d09561a0 req-28974d67-a1dc-4fa2-961d-18ff121a86c0 service nova] Enqueued Resource ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 with Priority: HIGHEST for action security_group_members [ 606.744097] env[65106]: INFO networking_nsxv3.common.synchronization [req-01724ce6-5b1d-43f8-9419-0122d09561a0 req-28974d67-a1dc-4fa2-961d-18ff121a86c0 service nova] Enqueued Resource ID: 5d0719ef-eee3-4adb-82c4-1bc98b49e032 with Priority: HIGHEST for action port [ 606.744097] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 with Priority: HIGHEST for action security_group_rules [ 606.744097] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 with Priority: HIGHEST for action security_group_members [ 606.744097] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d0719ef-eee3-4adb-82c4-1bc98b49e032 with Priority: HIGHEST for action port [ 606.744097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e524fc2-f045-49dd-9b9d-694845e21af8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.744097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.744444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.744480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.744563] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e524fc2-f045-49dd-9b9d-694845e21af8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.745958] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e524fc2-f045-49dd-9b9d-694845e21af8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.746072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.746160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.746357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.746525] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.746635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.746778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.746905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.747079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.747144] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e524fc2-f045-49dd-9b9d-694845e21af8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.748331] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d0719ef-eee3-4adb-82c4-1bc98b49e032 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.748447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d0719ef-eee3-4adb-82c4-1bc98b49e032" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.748447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d0719ef-eee3-4adb-82c4-1bc98b49e032" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.748676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d0719ef-eee3-4adb-82c4-1bc98b49e032" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.748676] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d0719ef-eee3-4adb-82c4-1bc98b49e032',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.109079] env[65106]: INFO networking_nsxv3.common.synchronization [req-e76f4adc-f47a-4e79-8f02-87f11ac972d8 req-82d732d9-d553-4e58-acc4-8fa7c98cec1f tempest-ImagesOneServerNegativeTestJSON-531782934 tempest-ImagesOneServerNegativeTestJSON-531782934-project-member] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 607.109079] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 607.109079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.109079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.109079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.109079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.109079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.109079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.109079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.109079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.109079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.109079] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.194790] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c844632-55aa-48db-8ca5-f00fe2244035: rpc.has_security_group_logging(os_id): False [ 607.214798] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.214975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.215030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.216081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.216081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.216081] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.216081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.216081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.216081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.216081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.216371] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.216371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.216371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.216463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.216531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.216838] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.216988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.217068] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.217217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.217292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.217451] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c844632-55aa-48db-8ca5-f00fe2244035 is going to be created. [ 607.252122] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e524fc2-f045-49dd-9b9d-694845e21af8 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.252291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.252555] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e524fc2-f045-49dd-9b9d-694845e21af8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.253957] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d0719ef-eee3-4adb-82c4-1bc98b49e032 with status ACTIVE [ 607.255618] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.255761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.255761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.255978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.256246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.256826] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.256960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.257134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.257281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.257371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.257599] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.257718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.257785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.257945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.258048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.258840] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d0719ef-eee3-4adb-82c4-1bc98b49e032 is going to be updated. [ 607.287659] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.288892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.288892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.288892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.289221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.292638] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.292775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.292834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.293026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.293185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.293587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d0719ef-eee3-4adb-82c4-1bc98b49e032" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.315360] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c844632-55aa-48db-8ca5-f00fe2244035 in Status: IN_PROGRESS for 2s [ 607.459337] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-71 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.459599] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.459730] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.460068] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.460356] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.460509] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.460628] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.460898] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.461109] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.461350] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.461535] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.461605] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.461731] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.461812] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.461922] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.463186] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.481796] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.481796] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.481796] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.481796] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.482100] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.482232] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.482261] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.482638] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.482770] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf02d98-7f07-423b-9ee7-2e9f28d4ae65',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.614967] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.615739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.615739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.615739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.615739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.615739] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.616101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.616101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.616350] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.616350] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.616793] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd already deleted. [ 607.616793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.762540] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e524fc2-f045-49dd-9b9d-694845e21af8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.987399] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.987654] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.987780] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.988078] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.988318] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.988396] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 4cf02d98-7f07-423b-9ee7-2e9f28d4ae65 not found, creating... [ 607.988647] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.988770] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.988880] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.989100] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.989232] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.989501] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.989735] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.989793] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.990012] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.992044] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.992255] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 4cf02d98-7f07-423b-9ee7-2e9f28d4ae65 is going to be created. [ 608.015059] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.015316] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.015434] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.015699] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.015909] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.016136] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.270548] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.271163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.271163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.271163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.271385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.271385] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 is going to be created. [ 608.297222] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.297523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.297689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.298015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.298278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.309726] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 in Status: UNINITIALIZED for 2s [ 608.662260] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: SUCCESS [ 608.663725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.663725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.663725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.663725] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.663725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.663725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.663725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.663725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.663725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.663725] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.770176] env[65106]: INFO networking_nsxv3.common.synchronization [req-e76f4adc-f47a-4e79-8f02-87f11ac972d8 req-e463e300-f8ce-4ca0-a9a9-d168551222a0 service nova] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_rules [ 608.770176] env[65106]: INFO networking_nsxv3.common.synchronization [req-e76f4adc-f47a-4e79-8f02-87f11ac972d8 req-e463e300-f8ce-4ca0-a9a9-d168551222a0 service nova] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 608.770176] env[65106]: INFO networking_nsxv3.common.synchronization [req-e76f4adc-f47a-4e79-8f02-87f11ac972d8 req-e463e300-f8ce-4ca0-a9a9-d168551222a0 service nova] Enqueued Resource ID: 4cf02d98-7f07-423b-9ee7-2e9f28d4ae65 with Priority: HIGHEST for action port [ 608.770176] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_rules [ 608.770176] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 608.770176] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cf02d98-7f07-423b-9ee7-2e9f28d4ae65 with Priority: HIGHEST for action port [ 608.770990] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.770990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.770990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.770990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.770990] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.773041] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.773159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.773259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.773393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.773555] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.773661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.773720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.773865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.773944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.774064] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.774865] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.775365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.775365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.775365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.775365] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4cf02d98-7f07-423b-9ee7-2e9f28d4ae65',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.167017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.167483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.170028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.170028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.170028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.170028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.170917] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.262275] env[65106]: INFO networking_nsxv3.common.synchronization [req-cf7c9e84-4e01-40cc-9e4d-4341fc07cf76 req-997003ce-7080-4866-8523-6177372eb017 tempest-ImagesNegativeTestJSON-1194547505 tempest-ImagesNegativeTestJSON-1194547505-project-member] Enqueued Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGHEST for action security_group_members [ 609.262275] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGHEST for action security_group_members [ 609.263852] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb38d759-8a21-4a9b-a191-18a3de159f87 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.263852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.263852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.264277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.265047] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.265047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.265047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.266702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.266702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.266702] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.276967] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.278162] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.278290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.278417] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4cf02d98-7f07-423b-9ee7-2e9f28d4ae65 with status ACTIVE [ 609.278573] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.278689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.278744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.278995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.279105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.279276] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.279365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.279424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.280032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.280032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.280032] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.280032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.280032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.280410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.280444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.283039] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4cf02d98-7f07-423b-9ee7-2e9f28d4ae65 is going to be updated. [ 609.320475] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.320475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.320475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.320475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.320475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.320475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4cf02d98-7f07-423b-9ee7-2e9f28d4ae65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.328846] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c844632-55aa-48db-8ca5-f00fe2244035 in Status: SUCCESS [ 609.329539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.636561] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-16 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.636561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-16" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.636561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-16" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.636830] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-16" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.637112] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.637271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.637379] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.637584] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.637716] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.637910] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.638030] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.638131] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.638236] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.638325] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.641021] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.641021] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.657527] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.657527] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.657719] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.657845] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-16" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.658167] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.658335] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.658452] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.658903] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.658903] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a104bb7-cae7-42ac-a4a1-069c9c7a7e93',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.674399] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 416df7e5-52a8-484d-a488-4f4f2380f0a6: rpc.has_security_group_logging(os_id): False [ 609.692352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.692776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.693176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.694012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.694335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.694737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.695024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.695624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.695624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.695624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.695771] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.696270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.696270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.696270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.696270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.696437] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.696553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.696640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.696814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.696914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.697027] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 is going to be created. [ 609.758537] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.758814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.758921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.759183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.759383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.768320] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.768547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.768547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.768818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.768916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.769662] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.769662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.769662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.769662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.769662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.769884] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb38d759-8a21-4a9b-a191-18a3de159f87 already deleted. [ 609.769884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.772073] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: IN_PROGRESS for 2s [ 609.782515] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.164723] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.165017] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.165159] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.165502] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.165679] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.165839] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 1a104bb7-cae7-42ac-a4a1-069c9c7a7e93 not found, creating... [ 610.166140] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.166341] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.166492] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.166726] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.166853] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.167151] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.167373] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.167461] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.167631] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.167760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.167895] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 1a104bb7-cae7-42ac-a4a1-069c9c7a7e93 is going to be created. [ 610.194400] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.194687] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.194830] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.195017] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.195260] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.195487] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.284630] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.284807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.284863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.286106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.286106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.286106] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be created. [ 610.334084] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 in Status: SUCCESS [ 610.334276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.334402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.334732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.334950] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.335090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.335158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.335332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.335417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.335509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.335601] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e524fc2-f045-49dd-9b9d-694845e21af8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.351182] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.351182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.351182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.352073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.352073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.363993] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: UNINITIALIZED for 2s [ 610.838576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e524fc2-f045-49dd-9b9d-694845e21af8 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.838929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.838929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.839151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.839354] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.839450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.839539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.839672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.839777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.839971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.840049] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e524fc2-f045-49dd-9b9d-694845e21af8 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.840152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.840152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.840325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.840496] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.840550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.840788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.840788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.840930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.840930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.840991] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e524fc2-f045-49dd-9b9d-694845e21af8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.938028] env[65106]: INFO networking_nsxv3.common.synchronization [req-cf7c9e84-4e01-40cc-9e4d-4341fc07cf76 req-b1bc8518-4c64-4de8-a7fc-6538497addc7 service nova] Enqueued Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGHEST for action security_group_rules [ 610.938230] env[65106]: INFO networking_nsxv3.common.synchronization [req-cf7c9e84-4e01-40cc-9e4d-4341fc07cf76 req-b1bc8518-4c64-4de8-a7fc-6538497addc7 service nova] Enqueued Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGHEST for action security_group_members [ 610.938367] env[65106]: INFO networking_nsxv3.common.synchronization [req-cf7c9e84-4e01-40cc-9e4d-4341fc07cf76 req-b1bc8518-4c64-4de8-a7fc-6538497addc7 service nova] Enqueued Resource ID: 1a104bb7-cae7-42ac-a4a1-069c9c7a7e93 with Priority: HIGHEST for action port [ 610.939042] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGHEST for action security_group_rules [ 610.939213] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGHEST for action security_group_members [ 610.939351] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a104bb7-cae7-42ac-a4a1-069c9c7a7e93 with Priority: HIGHEST for action port [ 610.939679] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb38d759-8a21-4a9b-a191-18a3de159f87 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.939840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.939912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.940212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.940299] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.941451] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb38d759-8a21-4a9b-a191-18a3de159f87 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.941578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.941578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.941753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.941921] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.942036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.942288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.942288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.942398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.942530] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.944050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.944050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.944050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.944259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.944259] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a104bb7-cae7-42ac-a4a1-069c9c7a7e93',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.346429] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e524fc2-f045-49dd-9b9d-694845e21af8: rpc.has_security_group_logging(os_id): False [ 611.377058] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.377058] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.377058] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.377058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.378581] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.379268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.379567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.380589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.380589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.380589] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 is going to be created. [ 611.446471] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb38d759-8a21-4a9b-a191-18a3de159f87 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.447194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.447194] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.447930] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a104bb7-cae7-42ac-a4a1-069c9c7a7e93 with status ACTIVE [ 611.447930] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.448157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.448157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.448285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.448399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.448567] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.448678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.448742] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.448921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.449009] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.449229] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.449361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.449431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.449594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.449785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.449785] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a104bb7-cae7-42ac-a4a1-069c9c7a7e93 is going to be updated. [ 611.457813] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.458012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.458055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.458341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.458472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.473469] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 in Status: IN_PROGRESS for 2s [ 611.479704] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.479704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.479704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.479704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.479704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.479704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a104bb7-cae7-42ac-a4a1-069c9c7a7e93" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.788023] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: SUCCESS [ 611.788258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.953209] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.248425] env[65106]: INFO networking_nsxv3.common.synchronization [req-7fcaac0d-3ce9-43a6-8475-59da7e154476 req-ea84bfd2-5e34-46de-8f1b-b4017e92188a tempest-ServersAdminTestJSON-1615839610 tempest-ServersAdminTestJSON-1615839610-project-member] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 612.248425] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 612.248503] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.249420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.249420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.249420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.250401] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.254051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.254171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.254392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.254492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.256351] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.378635] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 612.378992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.379078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.379305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.379528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.379658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.379726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.379892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.379975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.380077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.380170] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.458952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.459205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.459205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.459464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.459547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.459650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb38d759-8a21-4a9b-a191-18a3de159f87 is going to be created. [ 612.490767] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.490767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.490767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.490767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.490767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.508355] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb38d759-8a21-4a9b-a191-18a3de159f87 in Status: UNINITIALIZED for 2s [ 612.758568] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.758816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.758902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.759152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.759298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.759526] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.759665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.759729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.759856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.760112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.760112] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 already deleted. [ 612.760112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.823381] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.824633] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.824633] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.824633] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.828153] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.828153] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.828153] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.828153] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.828153] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.828153] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.828153] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 612.828153] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 612.828153] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 612.828153] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 612.828153] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 612.828153] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 612.851349] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 612.851590] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 612.852094] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 612.852094] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.852423] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-82827503-c0f3-4020-8b53-791610126f27 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.852607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-82827503-c0f3-4020-8b53-791610126f27" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.852721] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-82827503-c0f3-4020-8b53-791610126f27" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.853209] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-82827503-c0f3-4020-8b53-791610126f27" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.853312] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82827503-c0f3-4020-8b53-791610126f27',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.886149] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.886149] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.886149] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.886149] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.886149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.886785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.886785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.886785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.886785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.886785] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.251096] env[65106]: INFO networking_nsxv3.common.synchronization [None req-30c43c5f-ab9d-456f-a8f3-bcea48bae6d2 None None] Enqueued Resource ID: f2166032-518f-47b2-885d-cfd1c88cafeb with Priority: HIGHEST for action port [ 613.251689] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2166032-518f-47b2-885d-cfd1c88cafeb with Priority: HIGHEST for action port [ 613.252036] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2166032-518f-47b2-885d-cfd1c88cafeb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.252430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2166032-518f-47b2-885d-cfd1c88cafeb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.252533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2166032-518f-47b2-885d-cfd1c88cafeb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.252768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2166032-518f-47b2-885d-cfd1c88cafeb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.252855] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2166032-518f-47b2-885d-cfd1c88cafeb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.358585] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.360199] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.360199] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.360199] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.360199] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.360199] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 82827503-c0f3-4020-8b53-791610126f27 not found, creating... [ 613.360484] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.361654] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.361654] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.361654] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.361654] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.361654] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.362019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.362019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.362174] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.362766] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.362986] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 82827503-c0f3-4020-8b53-791610126f27 is going to be created. [ 613.385390] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.385603] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.385794] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.386110] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.386368] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.386660] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-82827503-c0f3-4020-8b53-791610126f27" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.387811] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80c55b4c-229d-4278-a249-6eb0843ce4fd: rpc.has_security_group_logging(os_id): False [ 613.408298] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.408495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.408495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.408724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.408855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.409041] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.409191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.409297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.409541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.409652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.409924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.410397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.410397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.410397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.410397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.410646] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.410646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.410754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.410849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.410930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.411025] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be created. [ 613.485642] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 in Status: SUCCESS [ 613.486341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.497670] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.497670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.497670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.497670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.497670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.530323] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 613.755253] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f2166032-518f-47b2-885d-cfd1c88cafeb [ 613.755631] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.755968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.756147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.756347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.756439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.756537] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f2166032-518f-47b2-885d-cfd1c88cafeb already deleted. [ 613.756620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2166032-518f-47b2-885d-cfd1c88cafeb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.196873] env[65106]: INFO networking_nsxv3.common.synchronization [req-7fcaac0d-3ce9-43a6-8475-59da7e154476 req-c00b3bb9-16b8-4d00-8bea-6b33711f32a6 service nova] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_rules [ 614.197162] env[65106]: INFO networking_nsxv3.common.synchronization [req-7fcaac0d-3ce9-43a6-8475-59da7e154476 req-c00b3bb9-16b8-4d00-8bea-6b33711f32a6 service nova] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 614.198111] env[65106]: INFO networking_nsxv3.common.synchronization [req-7fcaac0d-3ce9-43a6-8475-59da7e154476 req-c00b3bb9-16b8-4d00-8bea-6b33711f32a6 service nova] Enqueued Resource ID: 82827503-c0f3-4020-8b53-791610126f27 with Priority: HIGHEST for action port [ 614.198911] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_rules [ 614.198911] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 614.198981] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82827503-c0f3-4020-8b53-791610126f27 with Priority: HIGHEST for action port [ 614.199526] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.199526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.199526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.199825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.199825] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.200971] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.200971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.200971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.201133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.201633] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.201633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.201633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.201633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.201957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.201957] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.205710] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-82827503-c0f3-4020-8b53-791610126f27 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.206355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82827503-c0f3-4020-8b53-791610126f27" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.206924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82827503-c0f3-4020-8b53-791610126f27" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.206924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82827503-c0f3-4020-8b53-791610126f27" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.206924] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82827503-c0f3-4020-8b53-791610126f27',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.529056] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb38d759-8a21-4a9b-a191-18a3de159f87 in Status: SUCCESS [ 614.529424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.529992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.529992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.529992] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.530201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.530201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.530335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.530385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.530457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.530542] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.709770] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.711695] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.711695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.711695] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82827503-c0f3-4020-8b53-791610126f27 with status ACTIVE [ 614.711695] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.711695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.711968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.712014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.712124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.712321] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.712455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.713349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.713349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.713349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.713349] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.713349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.713349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.713349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.713649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.713649] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82827503-c0f3-4020-8b53-791610126f27 is going to be updated. [ 614.743516] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.743516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.744325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.744608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.744755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.744992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82827503-c0f3-4020-8b53-791610126f27" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.875419] env[65106]: INFO networking_nsxv3.common.synchronization [req-4f3be74c-784f-474e-9af7-f64c25bc8fd9 req-914ae49d-0a91-45c0-bc29-db833a38ed49 tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 614.875419] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 614.875419] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.875419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.875732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.877055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.877146] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.877224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.880257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.880257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.880257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.880257] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.034646] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb38d759-8a21-4a9b-a191-18a3de159f87 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.034646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.034646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.034646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.034920] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.034920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.035050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.035518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.035518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.035518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.036032] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb38d759-8a21-4a9b-a191-18a3de159f87 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.036032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.036154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.036314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.036534] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.038055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.038055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.038055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.038055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.038055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.038374] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.215997] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.382084] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.382245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.382316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.382526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.382610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.382804] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.382894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.382955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.383122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.383256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.383360] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 already deleted. [ 615.383360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.523012] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b312fb20-a3b2-4c04-b6f5-15ff82142fa1 None None] Enqueued Resource ID: 1be97c0d-9c6e-4939-9f0d-dbec2b38f136 with Priority: HIGHEST for action port [ 615.523710] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1be97c0d-9c6e-4939-9f0d-dbec2b38f136 with Priority: HIGHEST for action port [ 615.523923] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1be97c0d-9c6e-4939-9f0d-dbec2b38f136 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.524633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1be97c0d-9c6e-4939-9f0d-dbec2b38f136" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.524732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1be97c0d-9c6e-4939-9f0d-dbec2b38f136" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.525015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1be97c0d-9c6e-4939-9f0d-dbec2b38f136" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.525111] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1be97c0d-9c6e-4939-9f0d-dbec2b38f136',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.544104] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 615.544469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.544648] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb38d759-8a21-4a9b-a191-18a3de159f87: rpc.has_security_group_logging(os_id): False [ 615.566675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.566988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.567141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.567609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.568453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.568836] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.569203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.569326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.569477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.569568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.569942] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.570317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.570407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.570606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.570745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.571786] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.571922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.571922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.572169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.572259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.572429] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb38d759-8a21-4a9b-a191-18a3de159f87 is going to be created. [ 615.635610] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.635982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.636055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.636296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.636531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.645297] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.645297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.645297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.645650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.645650] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.645772] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.645884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.646395] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.646592] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.646828] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.646972] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.647118] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.647243] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.647373] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.647689] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.647850] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.649534] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb38d759-8a21-4a9b-a191-18a3de159f87 in Status: IN_PROGRESS for 2s [ 615.669650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.670791] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.670970] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.671174] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.671522] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-8eb29200-c689-4a46-a2e3-0e13f17c46e0 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.671698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-8eb29200-c689-4a46-a2e3-0e13f17c46e0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.671812] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-8eb29200-c689-4a46-a2e3-0e13f17c46e0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.672394] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-8eb29200-c689-4a46-a2e3-0e13f17c46e0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.672394] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eb29200-c689-4a46-a2e3-0e13f17c46e0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.718673] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.718916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.718991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.719381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.719557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.719735] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be created. [ 615.757924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.758738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.758738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.758738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.758738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.797382] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: UNINITIALIZED for 2s [ 616.031521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1be97c0d-9c6e-4939-9f0d-dbec2b38f136 [ 616.031521] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.031521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.031521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.031521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.031521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.031521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1be97c0d-9c6e-4939-9f0d-dbec2b38f136 already deleted. [ 616.031521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1be97c0d-9c6e-4939-9f0d-dbec2b38f136" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.176289] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.176648] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.177295] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.177295] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.177782] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.177782] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 8eb29200-c689-4a46-a2e3-0e13f17c46e0 not found, creating... [ 616.177782] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.177976] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.177976] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.179313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.179313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.179313] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.179313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.179313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.179313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.179313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.179313] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 8eb29200-c689-4a46-a2e3-0e13f17c46e0 is going to be created. [ 616.208363] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.208565] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.208748] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.208957] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.209191] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.209458] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-8eb29200-c689-4a46-a2e3-0e13f17c46e0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.213778] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d87abf48-7dfa-4ee5-a4cb-c786c9711b73 None None] Enqueued Resource ID: df9b1af9-43eb-4646-9614-5c0435b70022 with Priority: HIGHEST for action port [ 616.214307] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df9b1af9-43eb-4646-9614-5c0435b70022 with Priority: HIGHEST for action port [ 616.215497] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-df9b1af9-43eb-4646-9614-5c0435b70022 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.215497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df9b1af9-43eb-4646-9614-5c0435b70022" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.215497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df9b1af9-43eb-4646-9614-5c0435b70022" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.215685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df9b1af9-43eb-4646-9614-5c0435b70022" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.215685] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df9b1af9-43eb-4646-9614-5c0435b70022',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.258821] env[65106]: INFO networking_nsxv3.common.synchronization [None req-47c9e74a-bd71-41c4-beaa-e59e47da9331 tempest-ServersWithSpecificFlavorTestJSON-165470677 tempest-ServersWithSpecificFlavorTestJSON-165470677-project-member] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_rules [ 616.261172] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_rules [ 616.262011] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.262196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.262299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.262672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.262797] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.718775] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df9b1af9-43eb-4646-9614-5c0435b70022 [ 616.719187] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.719907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.719907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.720100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.720251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.720819] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df9b1af9-43eb-4646-9614-5c0435b70022 already deleted. [ 616.720819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df9b1af9-43eb-4646-9614-5c0435b70022" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.786909] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.787123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.787206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.787353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.787442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.787546] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 already deleted. [ 616.787625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.970282] env[65106]: INFO networking_nsxv3.common.synchronization [req-4f3be74c-784f-474e-9af7-f64c25bc8fd9 req-498e71f5-fe80-4ade-8bd8-62a492ce1b27 service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 616.970282] env[65106]: INFO networking_nsxv3.common.synchronization [req-4f3be74c-784f-474e-9af7-f64c25bc8fd9 req-498e71f5-fe80-4ade-8bd8-62a492ce1b27 service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 616.970282] env[65106]: INFO networking_nsxv3.common.synchronization [req-4f3be74c-784f-474e-9af7-f64c25bc8fd9 req-498e71f5-fe80-4ade-8bd8-62a492ce1b27 service nova] Enqueued Resource ID: 8eb29200-c689-4a46-a2e3-0e13f17c46e0 with Priority: HIGHEST for action port [ 616.970282] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 616.970282] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 616.970282] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8eb29200-c689-4a46-a2e3-0e13f17c46e0 with Priority: HIGHEST for action port [ 616.970282] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.970282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.970282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.970282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.970282] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.974766] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.975140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.978151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.978151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.978151] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.978151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.978151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.978151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.978151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.978151] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.979130] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-8eb29200-c689-4a46-a2e3-0e13f17c46e0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.979808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8eb29200-c689-4a46-a2e3-0e13f17c46e0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.982278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8eb29200-c689-4a46-a2e3-0e13f17c46e0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.982278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8eb29200-c689-4a46-a2e3-0e13f17c46e0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.982278] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8eb29200-c689-4a46-a2e3-0e13f17c46e0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.292851] env[65106]: INFO networking_nsxv3.common.synchronization [None req-1282889c-855a-4b06-b1fb-91a58bdbc954 tempest-ServersWithSpecificFlavorTestJSON-165470677 tempest-ServersWithSpecificFlavorTestJSON-165470677-project-member] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_rules [ 617.293561] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_rules [ 617.293722] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.293827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.293895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.295160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.295160] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.485308] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.486432] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.486585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.487211] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8eb29200-c689-4a46-a2e3-0e13f17c46e0 with status ACTIVE [ 617.487211] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.487211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.487211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.487393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.487436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.487596] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.487712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.487754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.487986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.489240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.489436] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.489536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.489594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.489745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.489823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.489907] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8eb29200-c689-4a46-a2e3-0e13f17c46e0 is going to be updated. [ 617.515018] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.515153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.515153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.515397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.515492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.515651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8eb29200-c689-4a46-a2e3-0e13f17c46e0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.663517] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb38d759-8a21-4a9b-a191-18a3de159f87 in Status: SUCCESS [ 617.663862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.823057] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 617.823057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.823057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.824270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.824270] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.824270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.824270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.824270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.824270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.824270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.824270] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.826453] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.826820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.826820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.826928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.826977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.827147] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 already deleted. [ 617.827207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.995982] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.208106] env[65106]: INFO networking_nsxv3.common.synchronization [req-d0df24da-d067-42aa-a283-3f0d7fa60fa0 req-497f4d4e-d349-4966-8aa0-7dafcf2ce3eb tempest-MigrationsAdminTest-232602271 tempest-MigrationsAdminTest-232602271-project-member] Enqueued Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 618.208106] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 618.208106] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.208106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.208106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.208106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.208106] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.208106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.208106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.208454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.208454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.208454] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.332026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.332026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.332026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.332026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.333995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.334522] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.334914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.336820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.336820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.336820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.336820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.336820] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.467186] env[65106]: INFO networking_nsxv3.common.synchronization [None req-2665485a-e5d2-4d7a-92cc-deeb7994521c None None] Enqueued Resource ID: 23011496-ed46-48ff-b21f-420190416b60 with Priority: HIGHEST for action port [ 618.467879] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23011496-ed46-48ff-b21f-420190416b60 with Priority: HIGHEST for action port [ 618.468741] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-23011496-ed46-48ff-b21f-420190416b60 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.469204] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23011496-ed46-48ff-b21f-420190416b60" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.469204] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23011496-ed46-48ff-b21f-420190416b60" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.469731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23011496-ed46-48ff-b21f-420190416b60" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.469812] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23011496-ed46-48ff-b21f-420190416b60',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.501311] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.501311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.501311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.501311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.501311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.501311] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be created. [ 618.536692] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.536895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.537059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.537305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.538087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.552613] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: UNINITIALIZED for 2s [ 618.616373] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.616617] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.617270] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.617270] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.617538] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.617734] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.618037] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.618313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.618494] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.619177] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.619177] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.619177] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.619177] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.619972] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.619972] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.620785] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.643783] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.644051] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.644350] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.644445] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.644794] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.645030] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.645187] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.645608] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.645780] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca7f742c-15b4-4cc7-82b4-a99e7894eab5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.710497] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.712321] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.712321] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c already deleted. [ 618.712321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.843683] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f58b21a0-a1cb-4daa-9136-8c66dc9641d3: rpc.has_security_group_logging(os_id): False [ 618.865291] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.865429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.865497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.865716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.865803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.865978] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.868140] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.868140] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.868140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.868140] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be created. [ 618.942165] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.942165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.942165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.942165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.942165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.956998] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 618.976202] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23011496-ed46-48ff-b21f-420190416b60 [ 618.976202] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.976202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.976202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.976202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.976202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.976202] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23011496-ed46-48ff-b21f-420190416b60 already deleted. [ 618.976202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23011496-ed46-48ff-b21f-420190416b60" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.150437] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.150922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.150922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.151212] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.151402] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.151526] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port ca7f742c-15b4-4cc7-82b4-a99e7894eab5 not found, creating... [ 619.152027] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.152138] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.152180] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.152450] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.152596] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.152946] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.153130] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.153242] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.153455] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.153620] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.153781] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: ca7f742c-15b4-4cc7-82b4-a99e7894eab5 is going to be created. [ 619.179577] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.179893] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.179945] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.180233] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.180462] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.180931] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.937111] env[65106]: INFO networking_nsxv3.common.synchronization [req-d0df24da-d067-42aa-a283-3f0d7fa60fa0 req-1c5cdfd2-4985-4fa5-82d1-f3ffa95e79af service nova] Enqueued Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_rules [ 619.937427] env[65106]: INFO networking_nsxv3.common.synchronization [req-d0df24da-d067-42aa-a283-3f0d7fa60fa0 req-1c5cdfd2-4985-4fa5-82d1-f3ffa95e79af service nova] Enqueued Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 619.937427] env[65106]: INFO networking_nsxv3.common.synchronization [req-d0df24da-d067-42aa-a283-3f0d7fa60fa0 req-1c5cdfd2-4985-4fa5-82d1-f3ffa95e79af service nova] Enqueued Resource ID: ca7f742c-15b4-4cc7-82b4-a99e7894eab5 with Priority: HIGHEST for action port [ 619.938051] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_rules [ 619.938208] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 619.939040] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca7f742c-15b4-4cc7-82b4-a99e7894eab5 with Priority: HIGHEST for action port [ 619.939040] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.939040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.939040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.939040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.940026] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.940243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.940375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.943087] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.943087] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.943087] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.943087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.943087] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca7f742c-15b4-4cc7-82b4-a99e7894eab5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.444758] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.444758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.444758] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.445621] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca7f742c-15b4-4cc7-82b4-a99e7894eab5 with status ACTIVE [ 620.445826] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.446060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.446130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.446308] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.446400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.446570] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.447954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.447954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.447954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.447954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.448377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.449854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.449854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.449854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.450838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.450838] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca7f742c-15b4-4cc7-82b4-a99e7894eab5 is going to be updated. [ 620.476242] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.476417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.476503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.476929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.478372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.478552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca7f742c-15b4-4cc7-82b4-a99e7894eab5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.566535] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 620.566945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.566945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.567499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.567499] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.567654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.567654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.568013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.568013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.568013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.568166] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.707724] env[65106]: INFO networking_nsxv3.common.synchronization [None req-bbfac84f-6d63-441d-a09a-3c446d659a54 None None] Enqueued Resource ID: cd6f4d0f-506c-4ce9-8010-dc243ff03fcb with Priority: HIGHEST for action port [ 620.707979] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd6f4d0f-506c-4ce9-8010-dc243ff03fcb with Priority: HIGHEST for action port [ 620.708931] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd6f4d0f-506c-4ce9-8010-dc243ff03fcb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.709077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd6f4d0f-506c-4ce9-8010-dc243ff03fcb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.709145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd6f4d0f-506c-4ce9-8010-dc243ff03fcb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.709749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd6f4d0f-506c-4ce9-8010-dc243ff03fcb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.709847] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd6f4d0f-506c-4ce9-8010-dc243ff03fcb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.952947] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.972968] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 620.974081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.071126] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.071387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.071613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.071973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.075681] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.075681] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.075681] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.075681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.075681] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.212534] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd6f4d0f-506c-4ce9-8010-dc243ff03fcb [ 621.212853] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.213039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.213091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.213325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.213509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.213509] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd6f4d0f-506c-4ce9-8010-dc243ff03fcb already deleted. [ 621.213509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd6f4d0f-506c-4ce9-8010-dc243ff03fcb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.456265] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.456439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.456502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.457846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.457846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.457846] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c is going to be created. [ 621.491231] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.491231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.491231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.491231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.491231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.502822] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: UNINITIALIZED for 2s [ 621.577048] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4b9f28-129e-4614-b2d6-9173d8122416: rpc.has_security_group_logging(os_id): False [ 621.598189] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.598438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.599034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.599034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.599034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.599187] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.599297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.599488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.599720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.599804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.600134] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.600254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.600320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.600636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.600713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.600971] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.601198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.601310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.601608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.601707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.601801] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be created. [ 621.674317] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.674317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.674317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.674317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.674317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.686352] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d35a8f59-b3e9-49c3-a056-f06111e44f8a tempest-ServersV294TestFqdnHostnames-641786378 tempest-ServersV294TestFqdnHostnames-641786378-project-member] Enqueued Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_rules [ 621.689677] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_rules [ 621.690925] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 621.691219] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.691349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.691461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.691709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.691814] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.852666] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ced1106d-2c24-4140-906b-dc1daf1c6339 tempest-ServersV294TestFqdnHostnames-641786378 tempest-ServersV294TestFqdnHostnames-641786378-project-member] Enqueued Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_rules [ 621.853930] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_rules [ 621.853930] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.853930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.220137] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.220413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.220413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.220540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.220631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.220714] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 already deleted. [ 622.220792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.220939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.221117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.221198] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.744040] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.744983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.744983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.744983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.744983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.744983] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 already deleted. [ 622.744983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.175736] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0bcb7d39-01c6-420e-a7a3-198e5c0f979f None None] Enqueued Resource ID: 653558e9-bbd3-43ef-8544-ea288647a249 with Priority: HIGHEST for action port [ 623.176318] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 653558e9-bbd3-43ef-8544-ea288647a249 with Priority: HIGHEST for action port [ 623.176642] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-653558e9-bbd3-43ef-8544-ea288647a249 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.176758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-653558e9-bbd3-43ef-8544-ea288647a249" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.176823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-653558e9-bbd3-43ef-8544-ea288647a249" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.177194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-653558e9-bbd3-43ef-8544-ea288647a249" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.177295] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('653558e9-bbd3-43ef-8544-ea288647a249',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.304928] env[65106]: INFO networking_nsxv3.common.synchronization [None req-385963cf-1fc9-4e8a-96c3-b1c6b6604fa8 tempest-ServersTestJSON-1102962073 tempest-ServersTestJSON-1102962073-project-member] Enqueued Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_rules [ 623.305256] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_rules [ 623.305551] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dcae410-a891-453e-bd43-6b1770f373d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.305603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.305853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.306136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.306447] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.482933] env[65106]: INFO networking_nsxv3.common.synchronization [req-2680cada-0d14-4378-8f0a-a52e0d6ef185 req-4aea2707-5792-4421-8123-e6e7516b1e27 tempest-ServersAdminTestJSON-1615839610 tempest-ServersAdminTestJSON-1615839610-project-member] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 623.484708] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 623.485239] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.485438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.485553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.490344] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.490344] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.490501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.490600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.490901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.491091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.491285] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.497868] env[65106]: INFO networking_nsxv3.common.synchronization [None req-615150b0-9948-4192-b8a3-3dae60dfae39 tempest-ServersTestJSON-1102962073 tempest-ServersTestJSON-1102962073-project-member] Enqueued Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_rules [ 623.498597] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_rules [ 623.504775] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dcae410-a891-453e-bd43-6b1770f373d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.504868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.516430] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: SUCCESS [ 623.516639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.517412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.517412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.518269] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.518269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.518269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.518269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.518269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.518269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.518269] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.683680] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 653558e9-bbd3-43ef-8544-ea288647a249 [ 623.683680] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.683680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.683680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.683680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.683680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.683680] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:653558e9-bbd3-43ef-8544-ea288647a249 already deleted. [ 623.683680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-653558e9-bbd3-43ef-8544-ea288647a249" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.706662] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 623.706662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.830472] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.830595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.830632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.831700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.831700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.831700] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dcae410-a891-453e-bd43-6b1770f373d3 already deleted. [ 623.831700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.831700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.831700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.831954] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.996518] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.020512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.020747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.020858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.021130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.021520] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.021520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.021675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.021872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.022013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.022164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.022356] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.022676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.022785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.023015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.023228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.023369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.023453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.023641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.023768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.023852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.023941] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.109666] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.110021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.110021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.110249] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.110474] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.110631] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.110736] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.110936] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.111075] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.111418] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.111418] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.111555] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.111629] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.111726] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.111826] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.111944] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.136081] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.136081] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.136081] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.136081] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.136390] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-fc1292d1-5c26-4f12-8089-3a19e8c486f3 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.136390] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-fc1292d1-5c26-4f12-8089-3a19e8c486f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.136528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-fc1292d1-5c26-4f12-8089-3a19e8c486f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.136793] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-fc1292d1-5c26-4f12-8089-3a19e8c486f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.136924] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc1292d1-5c26-4f12-8089-3a19e8c486f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.358714] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.359203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.359203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.359203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.359203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.359656] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dcae410-a891-453e-bd43-6b1770f373d3 already deleted. [ 624.359656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.500036] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.527686] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49f44a93-5686-4d9d-984b-4efb2550596c: rpc.has_security_group_logging(os_id): False [ 624.550153] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.550467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.550619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.550907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.551016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.551264] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.551497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.551685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.551959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.552101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.552548] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.552548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.552548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.552800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.552800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.552984] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.553129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.553191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.553337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.553412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.553587] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c is going to be created. [ 624.640939] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.641281] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.641281] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.641767] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.641890] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.642277] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port fc1292d1-5c26-4f12-8089-3a19e8c486f3 not found, creating... [ 624.642814] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.643245] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.643504] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.644058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.644311] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.644796] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.645054] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.645294] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.645658] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.645869] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.646059] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: fc1292d1-5c26-4f12-8089-3a19e8c486f3 is going to be created. [ 624.661821] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.661821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.662101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.662234] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.662611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.679328] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: IN_PROGRESS for 2s [ 624.683948] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.684271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.684356] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.684761] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.685019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.685396] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-fc1292d1-5c26-4f12-8089-3a19e8c486f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.008173] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.008381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.008490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.008771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.008961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.009084] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 625.075575] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.075575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.075575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.075575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.075575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.088316] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 625.441844] env[65106]: INFO networking_nsxv3.common.synchronization [req-2680cada-0d14-4378-8f0a-a52e0d6ef185 req-7425acc0-3395-49c4-91fc-2f3b381c99b2 service nova] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_rules [ 625.442121] env[65106]: INFO networking_nsxv3.common.synchronization [req-2680cada-0d14-4378-8f0a-a52e0d6ef185 req-7425acc0-3395-49c4-91fc-2f3b381c99b2 service nova] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 625.442206] env[65106]: INFO networking_nsxv3.common.synchronization [req-2680cada-0d14-4378-8f0a-a52e0d6ef185 req-7425acc0-3395-49c4-91fc-2f3b381c99b2 service nova] Enqueued Resource ID: fc1292d1-5c26-4f12-8089-3a19e8c486f3 with Priority: HIGHEST for action port [ 625.442970] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_rules [ 625.446070] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 625.446223] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc1292d1-5c26-4f12-8089-3a19e8c486f3 with Priority: HIGHEST for action port [ 625.446770] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.446770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.446770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.446944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.447054] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.448794] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.451325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.452141] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc1292d1-5c26-4f12-8089-3a19e8c486f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.452141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc1292d1-5c26-4f12-8089-3a19e8c486f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.452141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc1292d1-5c26-4f12-8089-3a19e8c486f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.452141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc1292d1-5c26-4f12-8089-3a19e8c486f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.452141] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc1292d1-5c26-4f12-8089-3a19e8c486f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.953952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.956709] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc1292d1-5c26-4f12-8089-3a19e8c486f3 with status ACTIVE [ 625.956709] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.956709] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.956709] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.956709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.957593] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc1292d1-5c26-4f12-8089-3a19e8c486f3 is going to be updated. [ 625.980178] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.980327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.980423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.980755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.980917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.981131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc1292d1-5c26-4f12-8089-3a19e8c486f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.995400] env[65106]: INFO networking_nsxv3.common.synchronization [req-1be9753f-54e5-4564-b023-4bbd117a7673 req-d7aca5bb-7137-410d-ac98-8844173bd253 tempest-DeleteServersAdminTestJSON-1530246430 tempest-DeleteServersAdminTestJSON-1530246430-project-admin] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 625.995400] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 625.995920] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.995920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.995920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.996125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.996308] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.996366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.996442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.996595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.996658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.997047] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.504272] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.504272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.504272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.504272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.504272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.504272] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.504272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.504272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.504272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.504919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.504919] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 is going to be updated. [ 626.534844] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.535074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.535074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.535609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.535714] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.545271] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: IN_PROGRESS for 2s [ 626.589280] env[65106]: INFO networking_nsxv3.common.synchronization [req-5d39c30f-df5d-4244-a33e-929d3406b39c req-4a086202-2423-42ad-875f-51454b1dbe37 tempest-ServerDiagnosticsNegativeTest-374208017 tempest-ServerDiagnosticsNegativeTest-374208017-project-member] Enqueued Resource ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 with Priority: HIGHEST for action security_group_members [ 626.589924] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 with Priority: HIGHEST for action security_group_members [ 626.590245] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.590384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.590440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.590631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.590924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.590924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.590924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.591077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.591156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.591250] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.620354] env[65106]: INFO networking_nsxv3.common.synchronization [req-1dc83d14-3c35-4a68-ad6c-e715f9c2eb81 req-f2eb103f-11d7-47fc-8097-4484b4b51026 tempest-VolumesAssistedSnapshotsTest-469682830 tempest-VolumesAssistedSnapshotsTest-469682830-project-member] Enqueued Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_members [ 626.620864] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_members [ 626.622800] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.622940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.623035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.623302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.623492] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.623620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.623695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.623864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.624024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.624074] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.692133] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: SUCCESS [ 626.692304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.093802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.094060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.094314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.096228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.096342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.096556] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.096687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.096752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.096920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.096988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.097091] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 is going to be updated. [ 627.100254] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 627.100254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.100254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.100683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.100683] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.100683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.100683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.100818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.100967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.104120] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.125950] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.126150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.126223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.126694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.126694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.126935] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.126935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.126935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.127131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.127177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.127259] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 already deleted. [ 627.127357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.129072] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.129228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.129286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.129576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.129642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.139804] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 in Status: IN_PROGRESS for 2s [ 627.417629] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-720 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.418092] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.418092] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.418373] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.418633] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.418791] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.418903] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.419133] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.419274] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.419560] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.419853] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 627.419853] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 627.419853] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 627.419978] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 627.420060] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 627.420190] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 627.441744] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 627.441744] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 627.441744] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 627.441744] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-720" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.442016] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.442187] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.442297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.442628] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.442758] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c920062-8bc1-4e4e-93fa-9dc8b4731b21',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.606297] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.945338] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.946120] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.946120] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.946594] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.946594] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.946594] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 1c920062-8bc1-4e4e-93fa-9dc8b4731b21 not found, creating... [ 627.950024] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.950024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.950024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.950024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.950024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.950024] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.950024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.950024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.950024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.950024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.950465] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 1c920062-8bc1-4e4e-93fa-9dc8b4731b21 is going to be created. [ 627.972061] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.972335] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.972506] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.972871] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.973184] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.973463] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.996963] env[65106]: INFO networking_nsxv3.common.synchronization [None req-67de85b5-6258-4b0e-8917-c0d21d8a1261 None None] Enqueued Resource ID: e631c3d5-9a6c-4f19-8af9-4e6d3948cc70 with Priority: HIGHEST for action port [ 627.997546] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e631c3d5-9a6c-4f19-8af9-4e6d3948cc70 with Priority: HIGHEST for action port [ 627.997842] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-e631c3d5-9a6c-4f19-8af9-4e6d3948cc70 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.997971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e631c3d5-9a6c-4f19-8af9-4e6d3948cc70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.998168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e631c3d5-9a6c-4f19-8af9-4e6d3948cc70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.998563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e631c3d5-9a6c-4f19-8af9-4e6d3948cc70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.998563] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e631c3d5-9a6c-4f19-8af9-4e6d3948cc70',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.109156] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.500868] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e631c3d5-9a6c-4f19-8af9-4e6d3948cc70 [ 628.500868] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.500868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.500868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.500868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.500868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.500868] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e631c3d5-9a6c-4f19-8af9-4e6d3948cc70 already deleted. [ 628.501309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e631c3d5-9a6c-4f19-8af9-4e6d3948cc70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.555456] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: SUCCESS [ 628.555665] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 deletion is rescheduled due to dependency. [ 628.555779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.613596] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.614154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.614154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.614154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.614154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.614493] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 628.651419] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.651705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.651705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.651925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.652104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.667464] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 628.692235] env[65106]: INFO networking_nsxv3.common.synchronization [None req-4919a2e8-14ca-4cb0-9dfb-75da047d3d02 None None] Enqueued Resource ID: 80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0 with Priority: HIGHEST for action port [ 628.692804] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0 with Priority: HIGHEST for action port [ 628.694226] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.694226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.694226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.694226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.694226] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.717695] env[65106]: INFO networking_nsxv3.common.synchronization [req-1dc83d14-3c35-4a68-ad6c-e715f9c2eb81 req-a925c2f1-84bc-469e-a3d0-43668d5908f7 service nova] Enqueued Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_rules [ 628.718048] env[65106]: INFO networking_nsxv3.common.synchronization [req-1dc83d14-3c35-4a68-ad6c-e715f9c2eb81 req-a925c2f1-84bc-469e-a3d0-43668d5908f7 service nova] Enqueued Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_members [ 628.718048] env[65106]: INFO networking_nsxv3.common.synchronization [req-1dc83d14-3c35-4a68-ad6c-e715f9c2eb81 req-a925c2f1-84bc-469e-a3d0-43668d5908f7 service nova] Enqueued Resource ID: 1c920062-8bc1-4e4e-93fa-9dc8b4731b21 with Priority: HIGHEST for action port [ 628.718213] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_rules [ 628.718347] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_members [ 628.718630] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c920062-8bc1-4e4e-93fa-9dc8b4731b21 with Priority: HIGHEST for action port [ 628.718953] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.719100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.719168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.719360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.719437] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.720537] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.720651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.720719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.720888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.721132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.721132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.721247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.721340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.721425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.721535] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.722747] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.722747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.722747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.722747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.722747] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c920062-8bc1-4e4e-93fa-9dc8b4731b21',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.154688] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 in Status: SUCCESS [ 629.154688] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9 deletion is rescheduled due to dependency. [ 629.154688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.199055] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0 [ 629.199055] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.199055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.199055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.199055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.199055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.199055] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0 already deleted. [ 629.199055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80c0bb3b-b9b2-490e-88f9-58ad26c8d4b0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.224368] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c920062-8bc1-4e4e-93fa-9dc8b4731b21 with status ACTIVE [ 629.224578] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.224749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.225725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.225725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.225725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.225725] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.225725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.225725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.225725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.225725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.226090] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.226090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.226090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.227431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.227431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.227431] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c920062-8bc1-4e4e-93fa-9dc8b4731b21 is going to be updated. [ 629.231019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.231019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.231019] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.258398] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.258398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.258622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.259438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.259438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.259438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c920062-8bc1-4e4e-93fa-9dc8b4731b21" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.476247] env[65106]: INFO networking_nsxv3.common.synchronization [req-1e2c3aaa-4180-4051-9f4f-f1f3c2e046bb req-0ec2f96d-fa54-424a-8e06-3e488b684214 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 629.479176] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 629.479577] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.479764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.479955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.480278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.480594] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.480720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.480779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.481032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.481145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.481310] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.735193] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.896524] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.896761] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-657" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.896896] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-657" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.897237] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-657" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.897514] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.897679] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.898155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.898638] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.898804] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.899043] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.899170] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.899528] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.899528] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.899528] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.900185] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.900185] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.926366] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.926366] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.926366] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.926636] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-657" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.927079] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-74992e22-c546-43b6-8a8b-4c4886017e76 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.929020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.930283] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.930659] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.930843] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74992e22-c546-43b6-8a8b-4c4886017e76',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.990448] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.990448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.990448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.990448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.990448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.990448] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.990686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.990686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.990686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.990779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.990850] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 already deleted. [ 629.991684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.098334] env[65106]: INFO networking_nsxv3.common.synchronization [None req-c204f619-ea7e-4fdf-b6a8-d44403fff41f None None] Enqueued Resource ID: 7168a340-1257-4b28-9700-db2cee211848 with Priority: HIGHEST for action port [ 630.099027] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7168a340-1257-4b28-9700-db2cee211848 with Priority: HIGHEST for action port [ 630.099723] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7168a340-1257-4b28-9700-db2cee211848 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.099855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7168a340-1257-4b28-9700-db2cee211848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.099915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7168a340-1257-4b28-9700-db2cee211848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.100183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7168a340-1257-4b28-9700-db2cee211848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.100262] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7168a340-1257-4b28-9700-db2cee211848',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.238124] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.238254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.238366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.238534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.238636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.238705] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 is going to be created. [ 630.263233] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.263386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.263454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.263642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.263926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.272860] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 in Status: UNINITIALIZED for 2s [ 630.437397] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.438438] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.438438] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.438438] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.438438] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.438729] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 74992e22-c546-43b6-8a8b-4c4886017e76 not found, creating... [ 630.439136] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.439136] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.439251] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.439898] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.439898] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.440138] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.440541] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.440541] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.440669] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.440813] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.440923] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 74992e22-c546-43b6-8a8b-4c4886017e76 is going to be created. [ 630.468938] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.468938] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.469543] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.469543] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.470138] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.470138] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.604295] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7168a340-1257-4b28-9700-db2cee211848 [ 630.604295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.604295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.604295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.604295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.604295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.604295] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7168a340-1257-4b28-9700-db2cee211848 already deleted. [ 630.604295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7168a340-1257-4b28-9700-db2cee211848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.669756] env[65106]: INFO networking_nsxv3.common.synchronization [None req-1a975f04-ba1f-4efd-9575-9cffb90c6f90 None None] Enqueued Resource ID: 1257e91d-b9d5-4dba-8bed-db632ddef428 with Priority: HIGHEST for action port [ 630.670224] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1257e91d-b9d5-4dba-8bed-db632ddef428 with Priority: HIGHEST for action port [ 630.670531] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1257e91d-b9d5-4dba-8bed-db632ddef428 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.670653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1257e91d-b9d5-4dba-8bed-db632ddef428" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.670720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1257e91d-b9d5-4dba-8bed-db632ddef428" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.670970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1257e91d-b9d5-4dba-8bed-db632ddef428" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.671117] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1257e91d-b9d5-4dba-8bed-db632ddef428',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.672625] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 630.672826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.676693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.676827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.677312] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.677312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.677312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.677545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.677647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.677757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.677848] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.764199] env[65106]: INFO networking_nsxv3.common.synchronization [req-98c81b1b-e01a-44b9-a3a7-919ca06b54bd req-4c86622d-0063-4a1f-976d-1425964d4238 tempest-MultipleCreateTestJSON-2038244732 tempest-MultipleCreateTestJSON-2038244732-project-member] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 630.764731] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 630.765210] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.765387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.765488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.765683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.765853] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.765948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.766052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.766183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.766268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.766351] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.179304] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1257e91d-b9d5-4dba-8bed-db632ddef428 [ 631.179598] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.179741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.179810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.180054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.180161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.180239] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1257e91d-b9d5-4dba-8bed-db632ddef428 already deleted. [ 631.180323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1257e91d-b9d5-4dba-8bed-db632ddef428" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.180675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.180785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.180899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.181059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.181235] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.181334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.181396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.181612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.182049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.182049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.182049] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.182049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.182229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.182333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.182605] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.182716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.182778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.182912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.182981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.183087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.183166] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.254926] env[65106]: INFO networking_nsxv3.common.synchronization [req-1e2c3aaa-4180-4051-9f4f-f1f3c2e046bb req-0640c79c-a82b-4218-9aa6-38613d1cd0d6 service nova] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 631.254926] env[65106]: INFO networking_nsxv3.common.synchronization [req-1e2c3aaa-4180-4051-9f4f-f1f3c2e046bb req-0640c79c-a82b-4218-9aa6-38613d1cd0d6 service nova] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 631.254926] env[65106]: INFO networking_nsxv3.common.synchronization [req-1e2c3aaa-4180-4051-9f4f-f1f3c2e046bb req-0640c79c-a82b-4218-9aa6-38613d1cd0d6 service nova] Enqueued Resource ID: 74992e22-c546-43b6-8a8b-4c4886017e76 with Priority: HIGHEST for action port [ 631.254926] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 631.255786] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 631.255786] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74992e22-c546-43b6-8a8b-4c4886017e76 with Priority: HIGHEST for action port [ 631.255786] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.255786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.255786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.256024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.256024] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.257698] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.257832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.258245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.258245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.258376] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.258445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.258498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.258662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.258752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.258860] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.260639] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-74992e22-c546-43b6-8a8b-4c4886017e76 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.260639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.260639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.260639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.260639] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74992e22-c546-43b6-8a8b-4c4886017e76',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.272623] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.272623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.272623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.272886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.272886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.273565] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.275469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.275469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.275469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.275648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.275648] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 already deleted. [ 631.275729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.284406] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.284406] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.284406] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.284406] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.284406] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.284406] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.284406] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.284406] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.284760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.284999] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.285140] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 631.285347] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 631.285469] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 631.285663] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 631.285778] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 631.286061] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 631.307608] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 631.307809] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 631.307962] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 631.308166] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.308486] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.308692] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.308800] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.309148] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.309307] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e8aa384-bc7c-41ca-8347-d38cb27f6c61',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.686224] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f58b21a0-a1cb-4daa-9136-8c66dc9641d3: rpc.has_security_group_logging(os_id): False [ 631.707054] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.708020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.708020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.708020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.708020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.708020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.708302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.708302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.708302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.708470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.708643] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.708736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.712027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.712027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.712027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.712027] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.712027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.712027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.712027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.712027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.712027] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 631.762028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.762253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.762526] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.764031] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74992e22-c546-43b6-8a8b-4c4886017e76 with status ACTIVE [ 631.764279] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.764585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.764585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.764673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.764709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.765494] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.765494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.765494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.765494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.765494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.765494] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.765494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.765878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.765878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.765878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.765878] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74992e22-c546-43b6-8a8b-4c4886017e76 is going to be updated. [ 631.781020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.781225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.781225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.781437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.781658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.790652] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.790870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.790870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.791176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.791319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.791545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.796073] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 631.814799] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.815065] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.815197] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.815482] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.815642] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.815804] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 6e8aa384-bc7c-41ca-8347-d38cb27f6c61 not found, creating... [ 631.816077] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.816231] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.816383] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.816607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.816739] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.817018] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.817169] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.817281] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.817550] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.817679] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.817811] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 6e8aa384-bc7c-41ca-8347-d38cb27f6c61 is going to be created. [ 631.881177] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.881401] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.881554] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.881910] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.882131] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.882331] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.266058] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.286586] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 in Status: SUCCESS [ 632.286847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.287176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.287309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.288144] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.288144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.288144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.288144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.288144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.288144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.288144] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.355134] env[65106]: INFO networking_nsxv3.common.synchronization [None req-982de751-57ab-43d5-b9e8-210234970194 tempest-ServerActionsTestOtherB-878484751 tempest-ServerActionsTestOtherB-878484751-project-member] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 632.355450] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 632.355905] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.356104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.356213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.356569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.356691] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.560822] env[65106]: INFO networking_nsxv3.common.synchronization [None req-86ed4c58-b233-461a-8fc0-ee9678a0beb5 tempest-ServerActionsTestOtherB-878484751 tempest-ServerActionsTestOtherB-878484751-project-member] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 632.561912] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 632.562279] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.562395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.619543] env[65106]: INFO networking_nsxv3.common.synchronization [req-98c81b1b-e01a-44b9-a3a7-919ca06b54bd req-c229475c-97f5-4b1f-af82-471734de8c45 service nova] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_rules [ 632.619748] env[65106]: INFO networking_nsxv3.common.synchronization [req-98c81b1b-e01a-44b9-a3a7-919ca06b54bd req-c229475c-97f5-4b1f-af82-471734de8c45 service nova] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 632.619910] env[65106]: INFO networking_nsxv3.common.synchronization [req-98c81b1b-e01a-44b9-a3a7-919ca06b54bd req-c229475c-97f5-4b1f-af82-471734de8c45 service nova] Enqueued Resource ID: 6e8aa384-bc7c-41ca-8347-d38cb27f6c61 with Priority: HIGHEST for action port [ 632.620736] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_rules [ 632.620736] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 632.620736] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e8aa384-bc7c-41ca-8347-d38cb27f6c61 with Priority: HIGHEST for action port [ 632.620965] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.621152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.621264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.621551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.621664] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.622897] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.622996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.623093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.623457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.623701] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.623845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.623925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.624122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.624238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.624523] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.625161] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.625265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.625326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.625479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.625553] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e8aa384-bc7c-41ca-8347-d38cb27f6c61',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.768907] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.770647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.770647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.770647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.770647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.770647] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be created. [ 632.791151] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.803029] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.803029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.803029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.803029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.803029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.818051] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: UNINITIALIZED for 2s [ 632.881014] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.881244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.881297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.881596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.881710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.881797] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4755538-f7a6-45f7-9a19-37103260244a already deleted. [ 632.881891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.882125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.882294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.882425] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.127278] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.127536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.127877] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.132609] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e8aa384-bc7c-41ca-8347-d38cb27f6c61 with status ACTIVE [ 633.132918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.133060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.133133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.133363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.133462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.133648] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.133745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.133803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.133954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.134276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.134276] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.134454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.134454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.134581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.134624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.134670] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e8aa384-bc7c-41ca-8347-d38cb27f6c61 is going to be updated. [ 633.160427] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.160682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.160761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.161073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.161326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.161658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e8aa384-bc7c-41ca-8347-d38cb27f6c61" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.293945] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac9de4d4-ec9d-4ad4-ad6f-65eee9862501: rpc.has_security_group_logging(os_id): False [ 633.323455] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.323663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.323663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.323979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.324098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.324373] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.324501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.324626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.324829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.324912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.325015] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 is going to be created. [ 633.408081] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.408554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.408554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.409349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.409349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.413334] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4755538-f7a6-45f7-9a19-37103260244a already deleted. [ 633.413334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.441577] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.441577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.441577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.441577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.441935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.460199] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 in Status: IN_PROGRESS for 2s [ 633.630415] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.810746] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 633.811149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.123432] env[65106]: INFO networking_nsxv3.common.synchronization [req-98c81b1b-e01a-44b9-a3a7-919ca06b54bd req-2137ed88-a493-456a-8672-38470e7a7e3e tempest-MultipleCreateTestJSON-2038244732 tempest-MultipleCreateTestJSON-2038244732-project-member] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 634.123975] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 634.125382] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.125546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.126317] env[65106]: INFO networking_nsxv3.common.synchronization [req-87f192a2-bfee-497c-afca-351563185d91 req-33058221-85eb-48d4-85e0-ae256d656b03 tempest-ImagesNegativeTestJSON-1194547505 tempest-ImagesNegativeTestJSON-1194547505-project-member] Enqueued Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGHEST for action security_group_members [ 634.126766] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGHEST for action security_group_members [ 634.127053] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb38d759-8a21-4a9b-a191-18a3de159f87 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.127171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.127234] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.127435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.127653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.127731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.127731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.127881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.127971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.128088] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.133140] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.133368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.133368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.133874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.133874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.133874] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be created. [ 634.162581] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.162838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.162947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.163233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.163314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.176507] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: UNINITIALIZED for 2s [ 634.551879] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.552061] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.552061] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.552349] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.552604] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.552747] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.552854] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.553083] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.553216] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.553422] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.553526] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.553620] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.553720] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.553822] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.553918] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.554643] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.577582] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.577908] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.578085] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.578282] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.578634] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-ea3a6a9f-d9cb-4432-b257-e64673224140 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.578856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-ea3a6a9f-d9cb-4432-b257-e64673224140" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.579112] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-ea3a6a9f-d9cb-4432-b257-e64673224140" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.579621] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-ea3a6a9f-d9cb-4432-b257-e64673224140" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.579684] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3a6a9f-d9cb-4432-b257-e64673224140',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.631551] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.632013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.632013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.632186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.632186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.633563] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.633563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.633563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.633563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.633563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.633563] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb38d759-8a21-4a9b-a191-18a3de159f87 is going to be updated. [ 634.678899] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.679486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.679486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.679486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.679733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.695296] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb38d759-8a21-4a9b-a191-18a3de159f87 in Status: IN_PROGRESS for 2s [ 634.827752] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 634.829028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.829028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.829028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.829028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.829265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.829265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.829265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.829361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.829427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.829531] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.082780] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.083484] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.083602] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.084134] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.084297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.084887] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port ea3a6a9f-d9cb-4432-b257-e64673224140 not found, creating... [ 635.087191] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.087191] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.087191] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.087191] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.087191] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.087191] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.087452] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.087452] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.087742] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.087887] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.088075] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: ea3a6a9f-d9cb-4432-b257-e64673224140 is going to be created. [ 635.115649] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.115857] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.119022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.119022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.119022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.119022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-ea3a6a9f-d9cb-4432-b257-e64673224140" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.334542] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.334809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.334809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.335576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.335576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.335576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.335576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.335576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.335948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.335948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.335948] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.335948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.336400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.336400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.336400] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.336400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.336823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.336823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.336823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.336823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.339600] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.478886] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 in Status: SUCCESS [ 635.479256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.841853] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143c4b09-e4ef-4609-8ff0-863f1dce9402: rpc.has_security_group_logging(os_id): False [ 635.870454] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.870722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.870722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.870943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.871090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.871269] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.871387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.871442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.871660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.871798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.872044] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.872177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.872312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.872411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.872502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.872683] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.872800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.872870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.873105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.873105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.873241] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be created. [ 635.965975] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.966273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.966273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.966464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.966601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.979740] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 636.027466] env[65106]: INFO networking_nsxv3.common.synchronization [req-bb14b2de-5dad-4fac-bd0d-2c632ee51fec req-b013d62f-cf27-45f2-aeef-f0b37eafde08 tempest-ServersWithSpecificFlavorTestJSON-165470677 tempest-ServersWithSpecificFlavorTestJSON-165470677-project-member] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 636.027466] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 636.027466] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.027466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.027466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.027466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.027466] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.027466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.027466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.027466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.027466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.027466] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.048874] env[65106]: INFO networking_nsxv3.common.synchronization [req-98c81b1b-e01a-44b9-a3a7-919ca06b54bd req-ed86696c-7392-4cad-b261-0091d9b01c29 service nova] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_rules [ 636.049051] env[65106]: INFO networking_nsxv3.common.synchronization [req-98c81b1b-e01a-44b9-a3a7-919ca06b54bd req-ed86696c-7392-4cad-b261-0091d9b01c29 service nova] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 636.049180] env[65106]: INFO networking_nsxv3.common.synchronization [req-98c81b1b-e01a-44b9-a3a7-919ca06b54bd req-ed86696c-7392-4cad-b261-0091d9b01c29 service nova] Enqueued Resource ID: ea3a6a9f-d9cb-4432-b257-e64673224140 with Priority: HIGHEST for action port [ 636.050058] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_rules [ 636.050197] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 636.050405] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea3a6a9f-d9cb-4432-b257-e64673224140 with Priority: HIGHEST for action port [ 636.050736] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.050843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.051176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.052102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.052102] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea3a6a9f-d9cb-4432-b257-e64673224140 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.052102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea3a6a9f-d9cb-4432-b257-e64673224140" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.052102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea3a6a9f-d9cb-4432-b257-e64673224140" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.052428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea3a6a9f-d9cb-4432-b257-e64673224140" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.052428] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea3a6a9f-d9cb-4432-b257-e64673224140',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.186545] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 636.186742] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.186891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.187120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.187299] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.187413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.187470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.187632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.187709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.187782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.188177] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.188682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.188842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.188992] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.189134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.189746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.189901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.189977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.190073] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.366558] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.366876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-934" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.366876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-934" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.367308] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-934" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.367609] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.367763] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.367925] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.368795] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.369101] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.369635] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.369694] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 636.369844] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 636.370119] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 636.370382] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 636.370609] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 636.370731] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 636.398053] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 636.398382] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 636.398844] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 636.399152] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-934" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.399647] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-7867e7c3-a11d-4ac9-af03-336174142503 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.399872] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-7867e7c3-a11d-4ac9-af03-336174142503" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.400450] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-7867e7c3-a11d-4ac9-af03-336174142503" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.400888] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-7867e7c3-a11d-4ac9-af03-336174142503" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.401124] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7867e7c3-a11d-4ac9-af03-336174142503',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.528514] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.528691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.528794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.528991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.529107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.529298] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.529403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.529476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.529631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.529708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.529791] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 already deleted. [ 636.529871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.556370] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea3a6a9f-d9cb-4432-b257-e64673224140 with status ACTIVE [ 636.556621] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.556741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.556741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.557014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.557065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.557243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.557346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.557400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.557541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.557611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.557785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.557890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.557940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.558075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.558172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.558228] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea3a6a9f-d9cb-4432-b257-e64673224140 is going to be updated. [ 636.599786] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.599999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.600064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.600264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.600399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.600554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea3a6a9f-d9cb-4432-b257-e64673224140" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.691914] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.692146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.692253] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.709195] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb38d759-8a21-4a9b-a191-18a3de159f87 in Status: SUCCESS [ 636.709436] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb38d759-8a21-4a9b-a191-18a3de159f87 deletion is rescheduled due to dependency. [ 636.709436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.904684] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.905591] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.905591] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.905591] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.905591] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.905750] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 7867e7c3-a11d-4ac9-af03-336174142503 not found, creating... [ 636.906102] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.906371] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.906371] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.906563] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.906848] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.907010] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.907820] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.907981] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.908254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.908360] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.908581] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 7867e7c3-a11d-4ac9-af03-336174142503 is going to be created. [ 636.938994] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.939345] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.940091] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.940299] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.940767] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.941155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-7867e7c3-a11d-4ac9-af03-336174142503" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.194147] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.615171] env[65106]: INFO networking_nsxv3.common.synchronization [req-bb14b2de-5dad-4fac-bd0d-2c632ee51fec req-88de067b-d734-4a1a-99fc-bd3885abb1b6 service nova] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_rules [ 637.615346] env[65106]: INFO networking_nsxv3.common.synchronization [req-bb14b2de-5dad-4fac-bd0d-2c632ee51fec req-88de067b-d734-4a1a-99fc-bd3885abb1b6 service nova] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 637.615477] env[65106]: INFO networking_nsxv3.common.synchronization [req-bb14b2de-5dad-4fac-bd0d-2c632ee51fec req-88de067b-d734-4a1a-99fc-bd3885abb1b6 service nova] Enqueued Resource ID: 7867e7c3-a11d-4ac9-af03-336174142503 with Priority: HIGHEST for action port [ 637.615704] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_rules [ 637.615834] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 637.615930] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7867e7c3-a11d-4ac9-af03-336174142503 with Priority: HIGHEST for action port [ 637.616498] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.616661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.616703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.616872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.616984] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.618292] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.618356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.618395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.618781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.618933] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.619048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.619114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.619251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.619558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.619686] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.620629] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7867e7c3-a11d-4ac9-af03-336174142503 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.621591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7867e7c3-a11d-4ac9-af03-336174142503" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.621679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7867e7c3-a11d-4ac9-af03-336174142503" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.623752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7867e7c3-a11d-4ac9-af03-336174142503" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.623752] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7867e7c3-a11d-4ac9-af03-336174142503',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.698290] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.698290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.698290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.698290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.698290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.698290] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 637.731049] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.731206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.731332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.731466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.731633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.743734] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 637.858558] env[65106]: INFO networking_nsxv3.common.synchronization [req-e8cec2b4-510c-40b7-971b-0ef78d776bb3 req-5383a100-a304-41b0-976a-cb6630a597dd tempest-TenantUsagesTestJSON-1694669173 tempest-TenantUsagesTestJSON-1694669173-project-member] Enqueued Resource ID: 1c844632-55aa-48db-8ca5-f00fe2244035 with Priority: HIGHEST for action security_group_members [ 637.858558] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c844632-55aa-48db-8ca5-f00fe2244035 with Priority: HIGHEST for action security_group_members [ 637.858558] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c844632-55aa-48db-8ca5-f00fe2244035 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.858809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.858809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.859166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.859812] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.859812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.859812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.859812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.859998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.859998] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c844632-55aa-48db-8ca5-f00fe2244035',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.004222] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 638.004523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.127426] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.128575] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.128732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.128814] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7867e7c3-a11d-4ac9-af03-336174142503 with status ACTIVE [ 638.128966] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.129088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.129152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.129379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.129442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.129606] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.129731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.129763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.131201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.131201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.131201] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.131201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.131201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.131201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.131201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.131201] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7867e7c3-a11d-4ac9-af03-336174142503 is going to be updated. [ 638.157430] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.157430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.157430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.157821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.157821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.157885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7867e7c3-a11d-4ac9-af03-336174142503" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.363718] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.364784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.364784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.364784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.364784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.365149] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.365242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.365307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.367208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.367208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.367208] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c844632-55aa-48db-8ca5-f00fe2244035 is going to be updated. [ 638.407096] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.408867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.409462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.409462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.409462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.424987] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c844632-55aa-48db-8ca5-f00fe2244035 in Status: IN_PROGRESS for 2s [ 638.633172] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.135929] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.136315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.136537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.136815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.136915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.137022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 is going to be created. [ 639.164188] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.164403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.164403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.164621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.164799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.177575] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: UNINITIALIZED for 2s [ 639.757252] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 639.757543] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.757816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.758872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.759598] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.759748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.759885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.760170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.761337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.761519] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.264433] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.438104] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c844632-55aa-48db-8ca5-f00fe2244035 in Status: SUCCESS [ 640.438288] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c844632-55aa-48db-8ca5-f00fe2244035 deletion is rescheduled due to dependency. [ 640.438405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c844632-55aa-48db-8ca5-f00fe2244035" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.447081] env[65106]: INFO networking_nsxv3.common.synchronization [req-67096eb4-ceb3-4b7f-a549-c61d2ccbc3dc req-423cdc1d-1983-41ae-ae73-1714bf85d743 tempest-ServersV294TestFqdnHostnames-641786378 tempest-ServersV294TestFqdnHostnames-641786378-project-member] Enqueued Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_members [ 640.447182] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_members [ 640.447512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.447648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.447805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.448614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.448614] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.448957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.448957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.448957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.449104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.449104] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.767372] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.942956] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-330 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.943276] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-330" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.943345] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-330" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.943632] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-330" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.943907] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.944511] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.944511] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.944511] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.944643] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.944748] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.944858] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.944943] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.945055] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.945159] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.945255] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.945377] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.952387] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.954230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.954230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.954230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.954230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.954230] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.954230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.954230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.954681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.954681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.954681] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 already deleted. [ 640.954681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.967214] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.967422] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.967504] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.967643] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-330" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.967954] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-117d0ede-a570-446f-a669-7fb5439196f1 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.968126] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-117d0ede-a570-446f-a669-7fb5439196f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.968234] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-117d0ede-a570-446f-a669-7fb5439196f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.968557] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-117d0ede-a570-446f-a669-7fb5439196f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.968682] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117d0ede-a570-446f-a669-7fb5439196f1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.188423] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: SUCCESS [ 641.188715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.188943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.189901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.189901] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.189901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.189901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.190441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.190441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.190441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.190441] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.269745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.270085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.270085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.270251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.270340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.270460] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 641.308735] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.308948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.308948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.309258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.309430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.319929] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 641.470653] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.471446] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.472144] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.472699] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.472840] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.473038] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 117d0ede-a570-446f-a669-7fb5439196f1 not found, creating... [ 641.473348] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.473518] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.473632] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.473871] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.477105] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.477105] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.477105] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.477105] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.477105] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.477105] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.477105] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 117d0ede-a570-446f-a669-7fb5439196f1 is going to be created. [ 641.517296] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.517637] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.517835] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.519207] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.519207] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.519207] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-117d0ede-a570-446f-a669-7fb5439196f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.693107] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.196060] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4202ae94-9151-4db6-b1be-f69fcc7dc349: rpc.has_security_group_logging(os_id): False [ 642.217332] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.217480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.217549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.217805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.217901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.218145] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.218245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.218309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.218459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.218534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.218618] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 is going to be created. [ 642.235783] env[65106]: INFO networking_nsxv3.common.synchronization [req-67096eb4-ceb3-4b7f-a549-c61d2ccbc3dc req-3077d35e-3153-4ab6-a7ca-cdf53879937a service nova] Enqueued Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_rules [ 642.235980] env[65106]: INFO networking_nsxv3.common.synchronization [req-67096eb4-ceb3-4b7f-a549-c61d2ccbc3dc req-3077d35e-3153-4ab6-a7ca-cdf53879937a service nova] Enqueued Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_members [ 642.236095] env[65106]: INFO networking_nsxv3.common.synchronization [req-67096eb4-ceb3-4b7f-a549-c61d2ccbc3dc req-3077d35e-3153-4ab6-a7ca-cdf53879937a service nova] Enqueued Resource ID: 117d0ede-a570-446f-a669-7fb5439196f1 with Priority: HIGHEST for action port [ 642.236628] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_rules [ 642.236773] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_members [ 642.236890] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 117d0ede-a570-446f-a669-7fb5439196f1 with Priority: HIGHEST for action port [ 642.239085] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.240876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.240977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.241237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.241322] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.243812] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.244029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.244111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.244335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.244676] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.244865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.244865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.244964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.245063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.245158] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.246271] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-117d0ede-a570-446f-a669-7fb5439196f1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.246271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-117d0ede-a570-446f-a669-7fb5439196f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.246423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-117d0ede-a570-446f-a669-7fb5439196f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.246457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-117d0ede-a570-446f-a669-7fb5439196f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.246532] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('117d0ede-a570-446f-a669-7fb5439196f1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.295443] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.295443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.295443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.295443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.295443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.316752] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: IN_PROGRESS for 2s [ 642.749429] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.749429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.749429] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.751116] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 117d0ede-a570-446f-a669-7fb5439196f1 with status ACTIVE [ 642.751297] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.751419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.751487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.751758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.751857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.752022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.752135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.752176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.752328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.752419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.752585] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.752675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.752722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.752864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.752937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.753139] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 117d0ede-a570-446f-a669-7fb5439196f1 is going to be updated. [ 642.776697] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.776893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.776893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.777133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.777522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.777522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-117d0ede-a570-446f-a669-7fb5439196f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.257352] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.332201] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 643.333381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.334032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.334342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.334610] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.334838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.334952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.335191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.335330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.335483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.335750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.335883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.335883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.336105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.336288] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.336429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.336485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.336641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.336759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.336843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.337593] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.644078] env[65106]: INFO networking_nsxv3.common.synchronization [None req-192efda4-b675-4ed7-8e44-d3ebc55ed4c2 None None] Enqueued Resource ID: c82272ec-cf00-4359-b641-0de81b3645a2 with Priority: HIGHEST for action port [ 643.644680] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c82272ec-cf00-4359-b641-0de81b3645a2 with Priority: HIGHEST for action port [ 643.645414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-c82272ec-cf00-4359-b641-0de81b3645a2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.645414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c82272ec-cf00-4359-b641-0de81b3645a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.645414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c82272ec-cf00-4359-b641-0de81b3645a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.645681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c82272ec-cf00-4359-b641-0de81b3645a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.645681] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c82272ec-cf00-4359-b641-0de81b3645a2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.763334] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.763507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.763599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.763821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.763912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.764027] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 is going to be created. [ 643.790097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.790288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.790337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.790618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.790658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.800578] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5e826db-704a-4f90-8b10-2d48839251d7 in Status: UNINITIALIZED for 2s [ 643.840976] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 032e481c-c000-4759-9f25-bd2a5ca64cb7: rpc.has_security_group_logging(os_id): False [ 643.860384] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.860550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.860603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.860818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.862219] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.862219] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.862219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.862631] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.862631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.862631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.864465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.864615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.864675] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be created. [ 643.940051] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.940051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.940051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.940051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.940051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.954232] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 644.149139] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c82272ec-cf00-4359-b641-0de81b3645a2 [ 644.152064] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.152064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.152064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.152064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.152064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.152064] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c82272ec-cf00-4359-b641-0de81b3645a2 already deleted. [ 644.152064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c82272ec-cf00-4359-b641-0de81b3645a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.335882] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: SUCCESS [ 644.336545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.740064] env[65106]: INFO networking_nsxv3.common.synchronization [None req-c50ecf02-ae62-4b8e-95c4-8fd0ba902d3d tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 645.741522] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 645.741522] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.741522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.741522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.741817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.742072] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.813771] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5e826db-704a-4f90-8b10-2d48839251d7 in Status: SUCCESS [ 645.814066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.814273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.814584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.814795] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.814957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.815057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.815650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.815800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.816106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.816106] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.978431] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 645.978700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.978851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.979105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.979191] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.988066] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b66e4845-211f-400c-bf63-c9a508f14061 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 645.988743] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 645.990778] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.990778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.266107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.266308] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.266373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.266665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.266775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.266899] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 already deleted. [ 646.266991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.267164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.267333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.267417] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.321568] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.488388] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.488565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.488631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.489028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.489530] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.489530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.489530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.489530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.489813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.489813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.489813] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.758953] env[65106]: INFO networking_nsxv3.common.synchronization [None req-56b5f118-a8f7-44ba-9845-36d6690b8599 None None] Enqueued Resource ID: 896bf333-6e54-452c-9b44-5571aee8965e with Priority: HIGHEST for action port [ 646.759602] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 896bf333-6e54-452c-9b44-5571aee8965e with Priority: HIGHEST for action port [ 646.760264] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-896bf333-6e54-452c-9b44-5571aee8965e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.760264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-896bf333-6e54-452c-9b44-5571aee8965e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.760264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-896bf333-6e54-452c-9b44-5571aee8965e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.760460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-896bf333-6e54-452c-9b44-5571aee8965e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.760543] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('896bf333-6e54-452c-9b44-5571aee8965e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.792983] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.794637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.794637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.794637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.794637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.794637] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 already deleted. [ 646.794637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.824421] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5e826db-704a-4f90-8b10-2d48839251d7: rpc.has_security_group_logging(os_id): False [ 646.845797] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.845935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.846044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.846354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.846354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.846565] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.846660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.846719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.846862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.846932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.847021] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 is going to be created. [ 646.918978] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.918978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.918978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.919850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.919850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.925260] env[65106]: INFO networking_nsxv3.common.synchronization [req-8bb6c611-ddf4-440f-a959-9d165a5af4a3 req-3f618729-eed8-4e26-96c8-9a4d5feb7f7b tempest-ServersTestJSON-1102962073 tempest-ServersTestJSON-1102962073-project-member] Enqueued Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_members [ 646.925905] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_members [ 646.926389] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcae410-a891-453e-bd43-6b1770f373d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.926691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.927273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.927501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.931145] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.931326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.931381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.931588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.931696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.931824] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.936515] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5e826db-704a-4f90-8b10-2d48839251d7 in Status: IN_PROGRESS for 2s [ 646.993849] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.994025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.994387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.994387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.994523] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.994641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.994706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.994857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.994980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.995199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.995268] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.995342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.995416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.995560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.995737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.996008] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.996156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.996325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.996412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.996497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.996591] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.262930] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 896bf333-6e54-452c-9b44-5571aee8965e [ 647.263271] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.263404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.263493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.263723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.263817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.264031] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:896bf333-6e54-452c-9b44-5571aee8965e already deleted. [ 647.264031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-896bf333-6e54-452c-9b44-5571aee8965e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.408593] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-103 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.408593] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-103" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.408593] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-103" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.408948] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-103" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.410528] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.410528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.410528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.410528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.410796] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.411237] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.411237] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.411237] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.411377] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.411455] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.411616] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.411813] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.434244] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.434467] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.434650] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.435076] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-103" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.435217] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-565170cc-0880-40a5-b694-1f69b40413b7 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.435645] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-565170cc-0880-40a5-b694-1f69b40413b7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.435645] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-565170cc-0880-40a5-b694-1f69b40413b7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.436009] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-565170cc-0880-40a5-b694-1f69b40413b7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.436400] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('565170cc-0880-40a5-b694-1f69b40413b7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.437993] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.438145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.438209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.438405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.438504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.438701] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.440221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.440221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.440221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.440221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.440221] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcae410-a891-453e-bd43-6b1770f373d3 already deleted. [ 647.440221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.499043] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 032e481c-c000-4759-9f25-bd2a5ca64cb7: rpc.has_security_group_logging(os_id): False [ 647.525939] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.526298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.526298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.526758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.526902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.527329] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.527466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.527588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.527812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.528360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.528360] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.528360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.528609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.528609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.528743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.529017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.529170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.529266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.529502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.529580] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.529682] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 647.598910] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.599092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.599162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.599390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.599689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.616035] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 647.941351] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.941774] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.941774] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.941931] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.942098] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.942312] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 565170cc-0880-40a5-b694-1f69b40413b7 not found, creating... [ 647.942599] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.942792] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.942911] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.943161] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.943294] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.943573] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.943725] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.943846] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.944104] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.944242] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.944363] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 565170cc-0880-40a5-b694-1f69b40413b7 is going to be created. [ 647.968238] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.968238] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.968238] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.968238] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.968238] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.968238] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-565170cc-0880-40a5-b694-1f69b40413b7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.709251] env[65106]: INFO networking_nsxv3.common.synchronization [req-8bb6c611-ddf4-440f-a959-9d165a5af4a3 req-bc603794-ba24-4c89-b963-f9387b95f444 service nova] Enqueued Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_rules [ 648.709541] env[65106]: INFO networking_nsxv3.common.synchronization [req-8bb6c611-ddf4-440f-a959-9d165a5af4a3 req-bc603794-ba24-4c89-b963-f9387b95f444 service nova] Enqueued Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_members [ 648.709775] env[65106]: INFO networking_nsxv3.common.synchronization [req-8bb6c611-ddf4-440f-a959-9d165a5af4a3 req-bc603794-ba24-4c89-b963-f9387b95f444 service nova] Enqueued Resource ID: 565170cc-0880-40a5-b694-1f69b40413b7 with Priority: HIGHEST for action port [ 648.710493] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_rules [ 648.710682] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_members [ 648.710845] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 565170cc-0880-40a5-b694-1f69b40413b7 with Priority: HIGHEST for action port [ 648.711256] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dcae410-a891-453e-bd43-6b1770f373d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.711437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.711490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.711866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.712064] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.713133] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcae410-a891-453e-bd43-6b1770f373d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.713302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.713370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.713545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.713695] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.713813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.713898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.715259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.715259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.715259] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.717745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-565170cc-0880-40a5-b694-1f69b40413b7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.717745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-565170cc-0880-40a5-b694-1f69b40413b7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.717745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-565170cc-0880-40a5-b694-1f69b40413b7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.717985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-565170cc-0880-40a5-b694-1f69b40413b7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.717985] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('565170cc-0880-40a5-b694-1f69b40413b7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.952491] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5e826db-704a-4f90-8b10-2d48839251d7 in Status: SUCCESS [ 648.952913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.221819] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.223886] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcae410-a891-453e-bd43-6b1770f373d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.224035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.224237] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 565170cc-0880-40a5-b694-1f69b40413b7 with status ACTIVE [ 649.224342] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.224409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.224488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.224660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.224747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.224945] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.225063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.225532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.225731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.225816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.226156] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.226156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.226270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.226365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.226520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.226520] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 565170cc-0880-40a5-b694-1f69b40413b7 is going to be updated. [ 649.252602] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.252863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.252863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.253022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.253181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.253357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-565170cc-0880-40a5-b694-1f69b40413b7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.585840] env[65106]: INFO networking_nsxv3.common.synchronization [req-169df152-d52a-4a12-a718-cf99a831e873 req-b57766d3-e864-41b0-8281-77e003948e7a tempest-ServersTestBootFromVolume-1396593016 tempest-ServersTestBootFromVolume-1396593016-project-member] Enqueued Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_members [ 649.587270] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_members [ 649.588207] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6947545-c4e6-4692-9dfa-c1bdd403650c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.588497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.588705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.589336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.589854] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.589981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.590230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.590528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.590632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.590856] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.632361] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 649.632620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.729352] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.926440] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-180 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.926805] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-180" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.926884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-180" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.927220] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-180" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.927624] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.927870] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.928377] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.928377] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.928678] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.928956] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.929151] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.929349] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.929618] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.929724] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.929928] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.930049] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.950088] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.950291] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.950515] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.950728] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-180" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.951806] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-c2b56132-1604-41fe-bc40-1fafd126fd9b taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.951806] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-c2b56132-1604-41fe-bc40-1fafd126fd9b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.951806] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-c2b56132-1604-41fe-bc40-1fafd126fd9b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.951806] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-c2b56132-1604-41fe-bc40-1fafd126fd9b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.952154] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b56132-1604-41fe-bc40-1fafd126fd9b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.093565] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.093565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.094138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.094138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.094138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.094273] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.094351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.094409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.094738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.094738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.094862] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6947545-c4e6-4692-9dfa-c1bdd403650c already deleted. [ 650.094902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.233699] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.234073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.234073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.234191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.234282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.234557] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcae410-a891-453e-bd43-6b1770f373d3 is going to be created. [ 650.237370] env[65106]: INFO networking_nsxv3.common.synchronization [None req-7d1bf084-6aa7-45d3-900c-5c6739aaed76 None None] Enqueued Resource ID: 9a184763-6481-4f4a-8975-8774b551006a with Priority: HIGHEST for action port [ 650.238118] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a184763-6481-4f4a-8975-8774b551006a with Priority: HIGHEST for action port [ 650.238754] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a184763-6481-4f4a-8975-8774b551006a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.238881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a184763-6481-4f4a-8975-8774b551006a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.238947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a184763-6481-4f4a-8975-8774b551006a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.239306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a184763-6481-4f4a-8975-8774b551006a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.239306] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a184763-6481-4f4a-8975-8774b551006a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.263413] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.263569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.263678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.263892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.264088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.274058] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcae410-a891-453e-bd43-6b1770f373d3 in Status: UNINITIALIZED for 2s [ 650.454640] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.454873] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.455030] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.455394] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.455696] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.455696] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port c2b56132-1604-41fe-bc40-1fafd126fd9b not found, creating... [ 650.455941] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.456110] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.456224] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.456445] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.457159] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.457159] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.457159] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.457331] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.457461] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.457589] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.457723] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: c2b56132-1604-41fe-bc40-1fafd126fd9b is going to be created. [ 650.482075] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.482326] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.482477] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.482863] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.483164] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.483392] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-c2b56132-1604-41fe-bc40-1fafd126fd9b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.732753] env[65106]: INFO networking_nsxv3.common.synchronization [req-0da0ee31-9f6b-48bf-af99-856a84274983 req-a9957d2f-60cc-4937-9f09-d7c2f35c4757 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 650.732942] env[65106]: INFO networking_nsxv3.common.synchronization [req-0da0ee31-9f6b-48bf-af99-856a84274983 req-a9957d2f-60cc-4937-9f09-d7c2f35c4757 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 650.734642] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 650.734831] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 650.736044] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.736180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.736248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.736451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.736705] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.736942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.736942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.737045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.738040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.738040] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.738435] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.738613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.738738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.739017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.739251] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.739419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.739519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.739738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.739859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.740644] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.741684] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a184763-6481-4f4a-8975-8774b551006a [ 650.741915] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.742656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.742656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.742656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.742656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.742656] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a184763-6481-4f4a-8975-8774b551006a already deleted. [ 650.743086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a184763-6481-4f4a-8975-8774b551006a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.783406] env[65106]: INFO networking_nsxv3.common.synchronization [req-0da0ee31-9f6b-48bf-af99-856a84274983 req-a9957d2f-60cc-4937-9f09-d7c2f35c4757 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 650.783598] env[65106]: INFO networking_nsxv3.common.synchronization [req-0da0ee31-9f6b-48bf-af99-856a84274983 req-a9957d2f-60cc-4937-9f09-d7c2f35c4757 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 650.783731] env[65106]: INFO networking_nsxv3.common.synchronization [req-0da0ee31-9f6b-48bf-af99-856a84274983 req-a9957d2f-60cc-4937-9f09-d7c2f35c4757 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_rules [ 650.783851] env[65106]: INFO networking_nsxv3.common.synchronization [req-0da0ee31-9f6b-48bf-af99-856a84274983 req-a9957d2f-60cc-4937-9f09-d7c2f35c4757 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 650.783974] env[65106]: INFO networking_nsxv3.common.synchronization [req-0da0ee31-9f6b-48bf-af99-856a84274983 req-a9957d2f-60cc-4937-9f09-d7c2f35c4757 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 74992e22-c546-43b6-8a8b-4c4886017e76 with Priority: HIGHEST for action port [ 650.784781] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 650.784978] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_rules [ 650.785128] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74992e22-c546-43b6-8a8b-4c4886017e76 with Priority: HIGHEST for action port [ 650.785252] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 650.785373] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 650.785763] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.785935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.786033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.786312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.786433] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.788042] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.788261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.788395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.788986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.788986] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.790930] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-74992e22-c546-43b6-8a8b-4c4886017e76 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.791079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.791148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.791339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.791415] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74992e22-c546-43b6-8a8b-4c4886017e76',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.792272] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.792358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.792552] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.792629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.238516] env[65106]: INFO networking_nsxv3.common.synchronization [req-169df152-d52a-4a12-a718-cf99a831e873 req-1afcb4cb-4dfd-4f57-a87e-6bd6dc072012 service nova] Enqueued Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_rules [ 651.238516] env[65106]: INFO networking_nsxv3.common.synchronization [req-169df152-d52a-4a12-a718-cf99a831e873 req-1afcb4cb-4dfd-4f57-a87e-6bd6dc072012 service nova] Enqueued Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_members [ 651.238516] env[65106]: INFO networking_nsxv3.common.synchronization [req-169df152-d52a-4a12-a718-cf99a831e873 req-1afcb4cb-4dfd-4f57-a87e-6bd6dc072012 service nova] Enqueued Resource ID: c2b56132-1604-41fe-bc40-1fafd126fd9b with Priority: HIGHEST for action port [ 651.238916] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_rules [ 651.240030] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_members [ 651.240237] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2b56132-1604-41fe-bc40-1fafd126fd9b with Priority: HIGHEST for action port [ 651.240573] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6947545-c4e6-4692-9dfa-c1bdd403650c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.240752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.240856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.243378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.243378] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.245560] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6947545-c4e6-4692-9dfa-c1bdd403650c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.245560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.245560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.245930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.246211] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.246356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.246461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.246751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.246855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.247553] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.249962] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2b56132-1604-41fe-bc40-1fafd126fd9b taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.252193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2b56132-1604-41fe-bc40-1fafd126fd9b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.252282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2b56132-1604-41fe-bc40-1fafd126fd9b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.252465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2b56132-1604-41fe-bc40-1fafd126fd9b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.253703] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2b56132-1604-41fe-bc40-1fafd126fd9b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.254976] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.254976] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.289030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.289174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.297549] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.298837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.298837] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74992e22-c546-43b6-8a8b-4c4886017e76 with status ACTIVE [ 651.298837] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.298837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.298837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.298837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.298837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.299345] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.299345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.299345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.299345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.299345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.299529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.299529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.299812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.299973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.300062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.300151] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74992e22-c546-43b6-8a8b-4c4886017e76 is going to be updated. [ 651.338528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.338528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.338664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.338779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.338912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.339079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.759460] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6947545-c4e6-4692-9dfa-c1bdd403650c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.759460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.759460] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.761727] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.762732] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.765082] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2b56132-1604-41fe-bc40-1fafd126fd9b with status ACTIVE [ 651.765082] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.765082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.765082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.765082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.765082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.765082] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.765082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.767179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.767440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.767549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.767839] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.767988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.768065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.768259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.768374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.768467] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2b56132-1604-41fe-bc40-1fafd126fd9b is going to be updated. [ 651.797650] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.797650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.797650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.798058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.798058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.798345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2b56132-1604-41fe-bc40-1fafd126fd9b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.260059] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.265251] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.265566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.265566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.266460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.266460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.266460] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be created. [ 652.271464] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.271675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.271818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.272069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.272163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.272283] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 652.292632] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcae410-a891-453e-bd43-6b1770f373d3 in Status: SUCCESS [ 652.292941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.293509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.293733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.293930] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.298053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.298053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.298053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.298053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.298053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.298053] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.298053] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.298053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.298053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.298053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.299159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.315436] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: UNINITIALIZED for 2s [ 652.321029] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.321029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.321029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.321029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.321029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.328501] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 652.712817] env[65106]: INFO networking_nsxv3.common.synchronization [None req-635f04c8-191c-4552-bdc7-3a29cd696f56 None None] Enqueued Resource ID: 02b9d2c7-123f-4e86-93df-39f954e77ae9 with Priority: HIGHEST for action port [ 652.713462] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02b9d2c7-123f-4e86-93df-39f954e77ae9 with Priority: HIGHEST for action port [ 652.713772] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-02b9d2c7-123f-4e86-93df-39f954e77ae9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.713916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02b9d2c7-123f-4e86-93df-39f954e77ae9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.714029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02b9d2c7-123f-4e86-93df-39f954e77ae9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.714332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02b9d2c7-123f-4e86-93df-39f954e77ae9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.714902] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02b9d2c7-123f-4e86-93df-39f954e77ae9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.764554] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.764835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.764835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.765094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.765244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.765301] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6947545-c4e6-4692-9dfa-c1bdd403650c is going to be created. [ 652.791887] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.792089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.792346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.792417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.792524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.802651] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.803947] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6947545-c4e6-4692-9dfa-c1bdd403650c in Status: UNINITIALIZED for 2s [ 653.217445] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02b9d2c7-123f-4e86-93df-39f954e77ae9 [ 653.217445] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.217625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.217710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.218026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.218076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.218186] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02b9d2c7-123f-4e86-93df-39f954e77ae9 already deleted. [ 653.218437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02b9d2c7-123f-4e86-93df-39f954e77ae9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.306323] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dcae410-a891-453e-bd43-6b1770f373d3: rpc.has_security_group_logging(os_id): False [ 653.329640] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.329826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.329826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.331976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.331976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.331976] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.331976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.331976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.331976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.331976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.331976] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dcae410-a891-453e-bd43-6b1770f373d3 is going to be created. [ 653.423032] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.423032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.423296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.423296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.423494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.437833] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dcae410-a891-453e-bd43-6b1770f373d3 in Status: IN_PROGRESS for 2s [ 654.328544] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: SUCCESS [ 654.329284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.331263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.331613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.331929] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.332116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.332200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.332472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.332595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.332736] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.345854] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 654.345854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.345854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.345854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.345854] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.345854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.345854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.345854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.345854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.346276] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.434997] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 801f4d67-386f-4801-8f6a-7817c5da92ef with Priority: HIGHEST for action security_group_members [ 654.435157] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 654.435611] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 654.441510] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 801f4d67-386f-4801-8f6a-7817c5da92ef with Priority: HIGHEST for action security_group_members [ 654.441510] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 654.441510] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 654.441510] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-801f4d67-386f-4801-8f6a-7817c5da92ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.441510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.441510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.441510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.441510] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.441510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.441510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.441510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.441510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.441510] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.441510] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.441510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.442730] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.442730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.492415] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 654.492581] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 654.492702] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 801f4d67-386f-4801-8f6a-7817c5da92ef with Priority: HIGHEST for action security_group_rules [ 654.492846] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 801f4d67-386f-4801-8f6a-7817c5da92ef with Priority: HIGHEST for action security_group_members [ 654.492973] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_rules [ 654.493122] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 654.493357] env[65106]: INFO networking_nsxv3.common.synchronization [req-b78c0ab2-513f-40e6-a984-b2f66c251b31 req-aa4fb3a5-401c-4dc2-937e-c50c8ab62cdd tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 74992e22-c546-43b6-8a8b-4c4886017e76 with Priority: HIGHEST for action port [ 654.493854] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 654.494181] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 801f4d67-386f-4801-8f6a-7817c5da92ef with Priority: HIGHEST for action security_group_rules [ 654.494454] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 654.494519] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74992e22-c546-43b6-8a8b-4c4886017e76 with Priority: HIGHEST for action port [ 654.494659] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_rules [ 654.494809] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 654.494849] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 801f4d67-386f-4801-8f6a-7817c5da92ef with Priority: HIGHEST for action security_group_members [ 654.495210] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.495363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.495619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-801f4d67-386f-4801-8f6a-7817c5da92ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.495755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.495845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.496290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.496414] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.497796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.497943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.498273] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-74992e22-c546-43b6-8a8b-4c4886017e76 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.498597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.498644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.498905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.499047] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74992e22-c546-43b6-8a8b-4c4886017e76',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.500399] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.500548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.501159] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.501416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.501590] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-801f4d67-386f-4801-8f6a-7817c5da92ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.501803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.816866] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6947545-c4e6-4692-9dfa-c1bdd403650c in Status: SUCCESS [ 654.816866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.816866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.816866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.816866] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.816866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.816866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.816866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.816866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.816866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.816866] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.837390] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.855281] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.945151] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.003339] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-801f4d67-386f-4801-8f6a-7817c5da92ef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.003553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.003650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74992e22-c546-43b6-8a8b-4c4886017e76 with status ACTIVE [ 655.003843] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.003952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.004031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.004332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.004456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.004594] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.004688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.004748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.004905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.006383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.006383] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.006383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.006383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.006383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.006383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.006383] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74992e22-c546-43b6-8a8b-4c4886017e76 is going to be updated. [ 655.034286] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.034497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.034549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.034851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.035080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.035329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74992e22-c546-43b6-8a8b-4c4886017e76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.318762] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.339324] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.356925] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.446966] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.451568] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dcae410-a891-453e-bd43-6b1770f373d3 in Status: SUCCESS [ 655.451568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.521633] env[65106]: INFO networking_nsxv3.common.synchronization [None req-a0ceadf6-4cbd-498b-8fd6-8e8f333d49b3 None None] Enqueued Resource ID: 64c51270-e6d4-4da3-a3e9-bdf565d4ee69 with Priority: HIGHEST for action port [ 655.522459] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64c51270-e6d4-4da3-a3e9-bdf565d4ee69 with Priority: HIGHEST for action port [ 655.522652] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-64c51270-e6d4-4da3-a3e9-bdf565d4ee69 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.522843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64c51270-e6d4-4da3-a3e9-bdf565d4ee69" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.522921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64c51270-e6d4-4da3-a3e9-bdf565d4ee69" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.524464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64c51270-e6d4-4da3-a3e9-bdf565d4ee69" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.524464] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64c51270-e6d4-4da3-a3e9-bdf565d4ee69',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.822685] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6947545-c4e6-4692-9dfa-c1bdd403650c: rpc.has_security_group_logging(os_id): False [ 655.842545] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.842755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.842901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.843140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.843239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.845063] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be updated. [ 655.849414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.849567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.849623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.849842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.850150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.850150] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.850276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.850389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.851792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.852557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.852557] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6947545-c4e6-4692-9dfa-c1bdd403650c is going to be created. [ 655.859590] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.859752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.859883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.860076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.860262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.860262] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 655.898386] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.898796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.898796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.899691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.899691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.904073] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.904331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.904331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.904647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.904647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.918950] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 655.920174] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: IN_PROGRESS for 2s [ 655.950621] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.950963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.950963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.951532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.951770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.953356] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.953477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.953736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.953964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.954069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.954161] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 801f4d67-386f-4801-8f6a-7817c5da92ef is going to be created. [ 655.980671] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6947545-c4e6-4692-9dfa-c1bdd403650c in Status: IN_PROGRESS for 2s [ 655.993972] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.995375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.995498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.995779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.996068] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.007296] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 801f4d67-386f-4801-8f6a-7817c5da92ef in Status: UNINITIALIZED for 2s [ 656.026060] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 64c51270-e6d4-4da3-a3e9-bdf565d4ee69 [ 656.026446] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.026673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.026792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.029201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.029398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.029620] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:64c51270-e6d4-4da3-a3e9-bdf565d4ee69 already deleted. [ 656.029906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64c51270-e6d4-4da3-a3e9-bdf565d4ee69" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.252529] env[65106]: INFO networking_nsxv3.common.synchronization [req-f20f05e0-5097-431c-ad58-dbc559ed63a6 req-e61eac42-1c74-4370-a3ce-fbda477be75b tempest-ServerActionsTestOtherB-878484751 tempest-ServerActionsTestOtherB-878484751-project-member] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 656.253239] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 656.253555] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.256115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.256115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.256115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.256115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.256115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.256115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.256115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.256436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.256436] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.650407] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-522 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.650986] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.650986] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.652468] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.653144] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.653744] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.653744] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.653744] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.653975] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.654044] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.654172] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 656.654875] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 656.654875] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 656.654875] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 656.654875] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 656.654875] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 656.683440] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 656.683646] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 656.683788] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 656.683972] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.685273] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-8413e823-63d9-4f09-a0f7-8136e40894cf taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.685273] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-8413e823-63d9-4f09-a0f7-8136e40894cf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.685273] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-8413e823-63d9-4f09-a0f7-8136e40894cf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.685273] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-8413e823-63d9-4f09-a0f7-8136e40894cf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.685273] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8413e823-63d9-4f09-a0f7-8136e40894cf',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.763958] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.764294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.764374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.764598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.764689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.764924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.765038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.765100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.765255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.765329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.765413] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a already deleted. [ 656.765492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.194581] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.194822] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.194965] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.195224] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.195345] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.195495] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 8413e823-63d9-4f09-a0f7-8136e40894cf not found, creating... [ 657.195749] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.195974] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.196094] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.196245] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.196329] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.197041] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.197041] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.197041] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.197409] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.197409] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.197538] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 8413e823-63d9-4f09-a0f7-8136e40894cf is going to be created. [ 657.218766] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.219056] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.219199] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.219479] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.219730] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.219951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-8413e823-63d9-4f09-a0f7-8136e40894cf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.895980] env[65106]: INFO networking_nsxv3.common.synchronization [req-f20f05e0-5097-431c-ad58-dbc559ed63a6 req-c7661b81-2da1-4b1b-aec1-c5ea74c5e6ea service nova] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 657.896239] env[65106]: INFO networking_nsxv3.common.synchronization [req-f20f05e0-5097-431c-ad58-dbc559ed63a6 req-c7661b81-2da1-4b1b-aec1-c5ea74c5e6ea service nova] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 657.896239] env[65106]: INFO networking_nsxv3.common.synchronization [req-f20f05e0-5097-431c-ad58-dbc559ed63a6 req-c7661b81-2da1-4b1b-aec1-c5ea74c5e6ea service nova] Enqueued Resource ID: 8413e823-63d9-4f09-a0f7-8136e40894cf with Priority: HIGHEST for action port [ 657.896720] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 657.896870] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 657.897088] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8413e823-63d9-4f09-a0f7-8136e40894cf with Priority: HIGHEST for action port [ 657.897311] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.897486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.897548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.897814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.897999] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.899229] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.899370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.899412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.899696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.899783] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.899880] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.899937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.900920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.900920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.900920] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.901123] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-8413e823-63d9-4f09-a0f7-8136e40894cf taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.901387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8413e823-63d9-4f09-a0f7-8136e40894cf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.901387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8413e823-63d9-4f09-a0f7-8136e40894cf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.901575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8413e823-63d9-4f09-a0f7-8136e40894cf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.901575] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8413e823-63d9-4f09-a0f7-8136e40894cf',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.929890] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 657.930249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.933172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.933172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.933172] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.933172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.933172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.933172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.933172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.933172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.933172] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.933641] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: SUCCESS [ 657.933641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.933710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.934457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.934457] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.934457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.934457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.934457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.934457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.934756] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.936674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.936674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.936674] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.936674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.936674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.936674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.936674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.936674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.936981] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.938632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.938632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.938859] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.938967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.939456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.939456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.939456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.939456] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.978635] env[65106]: INFO networking_nsxv3.common.synchronization [None req-778a91c2-0fcc-4a1b-8560-7ac7a918719a None None] Enqueued Resource ID: 3e2a6807-d037-4691-bc38-73505af16397 with Priority: HIGHEST for action port [ 657.978635] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e2a6807-d037-4691-bc38-73505af16397 with Priority: HIGHEST for action port [ 657.980325] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e2a6807-d037-4691-bc38-73505af16397 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.984892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e2a6807-d037-4691-bc38-73505af16397" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.984892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e2a6807-d037-4691-bc38-73505af16397" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.984892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e2a6807-d037-4691-bc38-73505af16397" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.984892] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e2a6807-d037-4691-bc38-73505af16397',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.998793] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6947545-c4e6-4692-9dfa-c1bdd403650c in Status: SUCCESS [ 657.999021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.019106] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 801f4d67-386f-4801-8f6a-7817c5da92ef in Status: SUCCESS [ 658.019304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.019833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.020280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.020280] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.020427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.020427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.020540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.020618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.020716] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.405209] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.405209] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.405209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.406527] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8413e823-63d9-4f09-a0f7-8136e40894cf with status ACTIVE [ 658.407132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.407427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.407596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.410730] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.410730] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.410730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.410730] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8413e823-63d9-4f09-a0f7-8136e40894cf is going to be updated. [ 658.435603] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.435603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.435603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.435797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.435797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.436450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8413e823-63d9-4f09-a0f7-8136e40894cf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.439898] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.443102] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.443102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.443102] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.443102] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.487248] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e2a6807-d037-4691-bc38-73505af16397 [ 658.487912] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.487912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.487912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.488124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.488585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.488585] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e2a6807-d037-4691-bc38-73505af16397 already deleted. [ 658.488585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e2a6807-d037-4691-bc38-73505af16397" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.524986] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.907970] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.942936] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.945128] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb69e9e4-2eab-4e65-ad5f-9c7914f93491: rpc.has_security_group_logging(os_id): False [ 658.946420] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.967245] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.967446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.967502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.967739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.967837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.968097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.968236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.968352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.968487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.968608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.968649] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be created. [ 659.029945] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.029945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.029945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.029945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.029945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.030497] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.042489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: IN_PROGRESS for 2s [ 659.415377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.415377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.415377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.415633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.416086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.416196] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be created. [ 659.441854] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.441854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.441854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.442396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.442571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.444786] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.444942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.444981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.445165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.445257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.445404] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 659.450372] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.450541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.450881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.450881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.450881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.450998] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be updated. [ 659.460162] env[65106]: INFO networking_nsxv3.common.synchronization [req-c1c01b84-cc31-45a5-8f92-ea55ec6c0d86 req-41d48933-5f80-4224-86b4-c749f609680b tempest-SecurityGroupRulesTestJSON-2091241041 tempest-SecurityGroupRulesTestJSON-2091241041-project-member] Enqueued Resource ID: 0b308e43-2c12-4d5d-a84b-5a00695b5a86 with Priority: HIGHEST for action security_group_rules [ 659.460162] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b308e43-2c12-4d5d-a84b-5a00695b5a86 with Priority: HIGHEST for action security_group_rules [ 659.460912] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: UNINITIALIZED for 2s [ 659.461186] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0b308e43-2c12-4d5d-a84b-5a00695b5a86 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.461297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0b308e43-2c12-4d5d-a84b-5a00695b5a86" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.461530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0b308e43-2c12-4d5d-a84b-5a00695b5a86" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.461615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0b308e43-2c12-4d5d-a84b-5a00695b5a86" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.461942] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0b308e43-2c12-4d5d-a84b-5a00695b5a86',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.482756] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.483029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.483029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.483244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.483414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.485342] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.485446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.485569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.485687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.486391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.499912] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: IN_PROGRESS for 2s [ 659.499912] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 659.521023] env[65106]: INFO networking_nsxv3.common.synchronization [None req-5fe8eb72-cba1-4637-8ed0-33d16eb02d66 None None] Enqueued Resource ID: 80b01713-65bc-4110-a744-d873b1a414f5 with Priority: HIGHEST for action port [ 659.521023] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80b01713-65bc-4110-a744-d873b1a414f5 with Priority: HIGHEST for action port [ 659.521023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-80b01713-65bc-4110-a744-d873b1a414f5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.521023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80b01713-65bc-4110-a744-d873b1a414f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.521023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80b01713-65bc-4110-a744-d873b1a414f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.521023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80b01713-65bc-4110-a744-d873b1a414f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.521023] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80b01713-65bc-4110-a744-d873b1a414f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.533015] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.533261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.533333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.533664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.534409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.534409] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 801f4d67-386f-4801-8f6a-7817c5da92ef is going to be updated. [ 659.593405] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.593577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.593628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.593824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.593961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.607617] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 801f4d67-386f-4801-8f6a-7817c5da92ef in Status: IN_PROGRESS for 2s [ 659.988124] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.988439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.988439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.988543] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.988656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.988735] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0b308e43-2c12-4d5d-a84b-5a00695b5a86 already deleted. [ 659.988816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0b308e43-2c12-4d5d-a84b-5a00695b5a86" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.023717] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80b01713-65bc-4110-a744-d873b1a414f5 [ 660.023717] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.023717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.023717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.023717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.023717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.023717] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80b01713-65bc-4110-a744-d873b1a414f5 already deleted. [ 660.023980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80b01713-65bc-4110-a744-d873b1a414f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.056191] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: SUCCESS [ 661.056583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.056583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.056804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.056928] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.471563] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 661.471653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.472033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.472752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.473052] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.473329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.473329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.473528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.473620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.473713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.473811] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.511268] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: SUCCESS [ 661.512103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.512905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.512905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.512905] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.513129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.513129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.513255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.513388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.513514] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.515280] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 661.515531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.516085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.516281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.516479] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.516609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.516690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.516854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.517018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.517018] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.560557] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.560708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.621940] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 801f4d67-386f-4801-8f6a-7817c5da92ef in Status: SUCCESS [ 661.621940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.621940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.621940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.622341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.622341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.622341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.622552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.622552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.622671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.622728] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.724037] env[65106]: INFO networking_nsxv3.common.synchronization [None req-65e7ad46-0a48-4220-a064-dc04a5c41046 None None] Enqueued Resource ID: 87ac3c9f-4ce6-409f-a111-8fee647f4333 with Priority: HIGHEST for action port [ 661.724610] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87ac3c9f-4ce6-409f-a111-8fee647f4333 with Priority: HIGHEST for action port [ 661.725248] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-87ac3c9f-4ce6-409f-a111-8fee647f4333 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.725248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87ac3c9f-4ce6-409f-a111-8fee647f4333" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.725363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87ac3c9f-4ce6-409f-a111-8fee647f4333" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.725921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87ac3c9f-4ce6-409f-a111-8fee647f4333" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.727902] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87ac3c9f-4ce6-409f-a111-8fee647f4333',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.978606] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.018394] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.019706] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.126214] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.230589] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87ac3c9f-4ce6-409f-a111-8fee647f4333 [ 662.230824] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.230962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.231046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.231278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.231367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.231460] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87ac3c9f-4ce6-409f-a111-8fee647f4333 already deleted. [ 662.231541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87ac3c9f-4ce6-409f-a111-8fee647f4333" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.484305] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4755538-f7a6-45f7-9a19-37103260244a: rpc.has_security_group_logging(os_id): False [ 662.484305] env[65106]: INFO networking_nsxv3.common.synchronization [req-fdea805b-7860-463d-84f8-d09c4f22487e req-c95ea0a6-cc5d-4d7c-8fd3-4a46758e182a tempest-ServersAdminNegativeTestJSON-1593145529 tempest-ServersAdminNegativeTestJSON-1593145529-project-member] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 662.484305] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 662.484920] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.485060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.485129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.485385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.485538] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.485635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.485689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.485839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.485920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.486024] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.509025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.509025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.509025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.509025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.509025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.509025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.509025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.509025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.509025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.509025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.509025] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be created. [ 662.522440] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.522955] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.576023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.576023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.576023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.576382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.576382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.592794] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 662.627966] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 801f4d67-386f-4801-8f6a-7817c5da92ef: rpc.has_security_group_logging(os_id): False [ 662.660733] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.660733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.660733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.660733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.661358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.661687] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.661882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.661983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.662488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.662488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.662559] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 801f4d67-386f-4801-8f6a-7817c5da92ef is going to be created. [ 662.760492] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.760712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.760712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.762271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.762489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.780561] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ccdf6c52-c3ee-4b66-bd37-3c2d9fe681f9 None None] Enqueued Resource ID: 5c4c4d9d-97a0-49c8-829a-98b19e8c1049 with Priority: HIGHEST for action port [ 662.782634] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 801f4d67-386f-4801-8f6a-7817c5da92ef in Status: IN_PROGRESS for 2s [ 662.783198] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c4c4d9d-97a0-49c8-829a-98b19e8c1049 with Priority: HIGHEST for action port [ 662.783657] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c4c4d9d-97a0-49c8-829a-98b19e8c1049 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.783894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c4c4d9d-97a0-49c8-829a-98b19e8c1049" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.783894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c4c4d9d-97a0-49c8-829a-98b19e8c1049" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.784104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c4c4d9d-97a0-49c8-829a-98b19e8c1049" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.784206] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c4c4d9d-97a0-49c8-829a-98b19e8c1049',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.989116] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.989468] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.989551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.990126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.990290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.990594] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.990775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.990775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.990953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.991049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.991141] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5872a413-0244-4425-a9f8-dd282f886327 already deleted. [ 662.991255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.024704] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.024955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.024955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.025256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.025366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.025461] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be updated. [ 663.026914] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.027097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.027162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.027361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.027456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.027548] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 663.076845] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.077044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.077093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.077759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.077759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.080158] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.080350] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.080455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.080832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.081026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.095029] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 663.095029] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: IN_PROGRESS for 2s [ 663.294110] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c4c4d9d-97a0-49c8-829a-98b19e8c1049 [ 663.294110] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.294110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.294110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.294110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.294110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.294110] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c4c4d9d-97a0-49c8-829a-98b19e8c1049 already deleted. [ 663.294110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c4c4d9d-97a0-49c8-829a-98b19e8c1049" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.389077] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.389273] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.389531] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.389792] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.390030] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.390214] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.390329] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.390556] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.390693] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.390898] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.391018] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.391116] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.391220] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.391423] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.391423] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.391522] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.412754] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.413141] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.413426] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.413514] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.413840] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-36d877d8-75a7-42e4-a692-cfd0c7f50e87 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.414024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-36d877d8-75a7-42e4-a692-cfd0c7f50e87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.414157] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-36d877d8-75a7-42e4-a692-cfd0c7f50e87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.414510] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-36d877d8-75a7-42e4-a692-cfd0c7f50e87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.414657] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d877d8-75a7-42e4-a692-cfd0c7f50e87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.916991] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.919561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.919561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.919561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.919561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.919561] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 36d877d8-75a7-42e4-a692-cfd0c7f50e87 not found, creating... [ 663.919561] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.919561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.919561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.919887] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.919887] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.920973] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.920973] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.920973] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.920973] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.920973] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.920973] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 36d877d8-75a7-42e4-a692-cfd0c7f50e87 is going to be created. [ 663.944617] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.944617] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.944617] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.944617] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.944906] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.945633] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-36d877d8-75a7-42e4-a692-cfd0c7f50e87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.541727] env[65106]: INFO networking_nsxv3.common.synchronization [None req-2779bb63-b8be-47ec-8ef3-0cc7b64d3b28 None None] Enqueued Resource ID: 239853ab-8cca-451e-8d59-f0ca3999718e with Priority: HIGHEST for action port [ 664.541727] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 239853ab-8cca-451e-8d59-f0ca3999718e with Priority: HIGHEST for action port [ 664.541727] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-239853ab-8cca-451e-8d59-f0ca3999718e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.541727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-239853ab-8cca-451e-8d59-f0ca3999718e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.541727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-239853ab-8cca-451e-8d59-f0ca3999718e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.542392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-239853ab-8cca-451e-8d59-f0ca3999718e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.542392] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('239853ab-8cca-451e-8d59-f0ca3999718e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.607516] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 664.607516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.647604] env[65106]: INFO networking_nsxv3.common.synchronization [req-fdea805b-7860-463d-84f8-d09c4f22487e req-15ff8046-35bc-4c8a-9ea9-37cda75f4c60 service nova] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_rules [ 664.647815] env[65106]: INFO networking_nsxv3.common.synchronization [req-fdea805b-7860-463d-84f8-d09c4f22487e req-15ff8046-35bc-4c8a-9ea9-37cda75f4c60 service nova] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 664.647996] env[65106]: INFO networking_nsxv3.common.synchronization [req-fdea805b-7860-463d-84f8-d09c4f22487e req-15ff8046-35bc-4c8a-9ea9-37cda75f4c60 service nova] Enqueued Resource ID: 36d877d8-75a7-42e4-a692-cfd0c7f50e87 with Priority: HIGHEST for action port [ 664.648682] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_rules [ 664.648927] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 664.649085] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36d877d8-75a7-42e4-a692-cfd0c7f50e87 with Priority: HIGHEST for action port [ 664.650026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.650094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.650167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.650351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.650426] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.651297] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.651393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.651579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.651634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.653360] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.653360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.653360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.653360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.653360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.653360] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.658211] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-36d877d8-75a7-42e4-a692-cfd0c7f50e87 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.659045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36d877d8-75a7-42e4-a692-cfd0c7f50e87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.659045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36d877d8-75a7-42e4-a692-cfd0c7f50e87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.659045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36d877d8-75a7-42e4-a692-cfd0c7f50e87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.659045] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36d877d8-75a7-42e4-a692-cfd0c7f50e87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.796319] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 801f4d67-386f-4801-8f6a-7817c5da92ef in Status: SUCCESS [ 664.796547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.880787] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d4e1c8b8-cdff-4b82-be94-50bdf23537ef None None] Enqueued Resource ID: ab097b6d-344e-4430-b2d2-1472ddc9a612 with Priority: HIGHEST for action port [ 664.881466] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab097b6d-344e-4430-b2d2-1472ddc9a612 with Priority: HIGHEST for action port [ 664.882491] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab097b6d-344e-4430-b2d2-1472ddc9a612 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.882491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab097b6d-344e-4430-b2d2-1472ddc9a612" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.882491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab097b6d-344e-4430-b2d2-1472ddc9a612" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.882491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab097b6d-344e-4430-b2d2-1472ddc9a612" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.882491] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab097b6d-344e-4430-b2d2-1472ddc9a612',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.935581] env[65106]: INFO networking_nsxv3.common.synchronization [req-a5f23f8a-7b8e-4f97-b791-b87f28b273e1 req-8e26b25e-caa6-476b-94ec-c3c101759cb9 tempest-MultipleCreateTestJSON-2038244732 tempest-MultipleCreateTestJSON-2038244732-project-member] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 664.935581] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 664.935756] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.935830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.935830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.936111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.936469] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.936469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.936469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.936619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.936720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.936804] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.044788] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 239853ab-8cca-451e-8d59-f0ca3999718e [ 665.045166] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.045166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.045322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.045447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.045540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.045638] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:239853ab-8cca-451e-8d59-f0ca3999718e already deleted. [ 665.045717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-239853ab-8cca-451e-8d59-f0ca3999718e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.107933] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: SUCCESS [ 665.107933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.107933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.107933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.107933] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.107933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.107933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.108529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.108661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.109075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.109256] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.111113] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 665.111390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.111761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.111761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.111866] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.113398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.113398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.113398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.113398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.113398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.113398] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.113398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.113398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.113398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.113842] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.113842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.114059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.114059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.114141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.114180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.114299] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.166088] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.166088] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.166088] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36d877d8-75a7-42e4-a692-cfd0c7f50e87 with status ACTIVE [ 665.166088] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.166088] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.166088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.166726] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.166726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.166726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.166726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.166726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.166726] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36d877d8-75a7-42e4-a692-cfd0c7f50e87 is going to be updated. [ 665.194547] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.194547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.194547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.194547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.194810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.194999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36d877d8-75a7-42e4-a692-cfd0c7f50e87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.385254] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab097b6d-344e-4430-b2d2-1472ddc9a612 [ 665.385497] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.385635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.385707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.385970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.386084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.386215] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab097b6d-344e-4430-b2d2-1472ddc9a612 already deleted. [ 665.386305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab097b6d-344e-4430-b2d2-1472ddc9a612" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.439776] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.617413] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.619986] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143c4b09-e4ef-4609-8ff0-863f1dce9402: rpc.has_security_group_logging(os_id): False [ 665.641802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.642021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.645079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.645079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.645079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.645079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.645700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.645700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.645700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.645700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.645700] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 665.669200] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.704345] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.704522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.704595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.704753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.704898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.717196] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 665.893449] env[65106]: INFO networking_nsxv3.common.synchronization [req-d4048686-9365-4a1c-acdd-23168ea17d44 req-0588b13f-7dff-4a1f-a46d-7d3d01ee9378 tempest-ListImageFiltersTestJSON-1907947682 tempest-ListImageFiltersTestJSON-1907947682-project-member] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 665.894048] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 665.894858] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.894858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.894858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.894858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.895087] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.895087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.895177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.898423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.898628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.898752] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.941783] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.123163] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb69e9e4-2eab-4e65-ad5f-9c7914f93491: rpc.has_security_group_logging(os_id): False [ 666.145429] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.145429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.145429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.145429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.145429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.145429] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.145429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.145429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.145429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.145429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.145429] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be updated. [ 666.171620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.173990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.173990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.173990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.173990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.173990] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5872a413-0244-4425-a9f8-dd282f886327 is going to be created. [ 666.204762] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.204762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.204762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.205349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.205349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.209227] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.209408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.209408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.211025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.211025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.228963] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: UNINITIALIZED for 2s [ 666.233038] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: IN_PROGRESS for 2s [ 666.401802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.402967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.402967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.402967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.402967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.402967] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.402967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.402967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.403624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.403624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.403624] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a already deleted. [ 666.403624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.446644] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.446815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.446868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.447089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.447984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.447984] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 666.478761] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.478761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.478761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.478923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.478923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.493057] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 666.593545] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.593756] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.593874] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.594145] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.595497] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.595497] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.595497] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.595497] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.595497] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.595802] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.595927] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 666.596049] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 666.596155] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 666.596262] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 666.596366] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 666.596490] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 666.618593] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 666.618924] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 666.619243] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 666.619243] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.619456] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-cd340134-695f-48b3-a926-eb4ab043b853 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.619625] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-cd340134-695f-48b3-a926-eb4ab043b853" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.619741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-cd340134-695f-48b3-a926-eb4ab043b853" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.620070] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-cd340134-695f-48b3-a926-eb4ab043b853" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.620212] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd340134-695f-48b3-a926-eb4ab043b853',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.122270] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.122467] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.122569] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.122856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.123079] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.123303] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port cd340134-695f-48b3-a926-eb4ab043b853 not found, creating... [ 667.123604] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.123767] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.124039] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.124139] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.124272] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.124576] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.124733] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.124847] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.125360] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.125807] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.125807] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: cd340134-695f-48b3-a926-eb4ab043b853 is going to be created. [ 667.148588] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.149068] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.149068] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.149368] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.149605] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.149900] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-cd340134-695f-48b3-a926-eb4ab043b853" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.528276] env[65106]: INFO networking_nsxv3.common.synchronization [req-0ee8d8f9-0ba3-40f7-9ad9-b7a8ad21645a req-49a7fe70-8d4b-47e9-980d-af46a7995af0 tempest-ServersAdminTestJSON-1615839610 tempest-ServersAdminTestJSON-1615839610-project-member] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 667.528818] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 667.529146] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.529251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.529317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.529747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.529982] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.530148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.530276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.530383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.530470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.530563] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.735110] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 667.735556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.735556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.736386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.736386] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.858682] env[65106]: INFO networking_nsxv3.common.synchronization [req-d4048686-9365-4a1c-acdd-23168ea17d44 req-5d1d84ef-c4cd-4080-be1b-856078d6f6e5 service nova] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_rules [ 667.858884] env[65106]: INFO networking_nsxv3.common.synchronization [req-d4048686-9365-4a1c-acdd-23168ea17d44 req-5d1d84ef-c4cd-4080-be1b-856078d6f6e5 service nova] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 667.859029] env[65106]: INFO networking_nsxv3.common.synchronization [req-d4048686-9365-4a1c-acdd-23168ea17d44 req-5d1d84ef-c4cd-4080-be1b-856078d6f6e5 service nova] Enqueued Resource ID: cd340134-695f-48b3-a926-eb4ab043b853 with Priority: HIGHEST for action port [ 667.859953] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_rules [ 667.859953] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 667.859953] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd340134-695f-48b3-a926-eb4ab043b853 with Priority: HIGHEST for action port [ 667.860209] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.860439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.860584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.860994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.861095] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.862669] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.862669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.862669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.862669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.862669] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.863317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.863317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.863317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.863465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.863465] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.867253] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd340134-695f-48b3-a926-eb4ab043b853 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.867253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd340134-695f-48b3-a926-eb4ab043b853" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.867253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd340134-695f-48b3-a926-eb4ab043b853" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.867253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd340134-695f-48b3-a926-eb4ab043b853" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.867253] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd340134-695f-48b3-a926-eb4ab043b853',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.960472] env[65106]: INFO networking_nsxv3.common.synchronization [None req-11b005b4-3eb9-4a32-892f-6c70ce65b131 None None] Enqueued Resource ID: a59199eb-cd75-4610-bbc0-c9b9db1a8478 with Priority: HIGHEST for action port [ 667.960763] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a59199eb-cd75-4610-bbc0-c9b9db1a8478 with Priority: HIGHEST for action port [ 667.961738] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a59199eb-cd75-4610-bbc0-c9b9db1a8478 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.961738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a59199eb-cd75-4610-bbc0-c9b9db1a8478" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.961738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a59199eb-cd75-4610-bbc0-c9b9db1a8478" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.961738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a59199eb-cd75-4610-bbc0-c9b9db1a8478" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.961978] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a59199eb-cd75-4610-bbc0-c9b9db1a8478',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.033235] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.239237] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.239237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.239237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.239237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.239717] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.239717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.239717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.239717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.239871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.239904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.239988] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.241510] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: SUCCESS [ 668.242426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.242426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.242549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.242715] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.242800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.242846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.243126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.243277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.243379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.243843] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.247013] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: SUCCESS [ 668.247363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.370572] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.372099] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.372099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.372099] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd340134-695f-48b3-a926-eb4ab043b853 with status ACTIVE [ 668.372373] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.372373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.372373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.372524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.372607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.372769] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.372860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.372921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.373397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.373480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.373685] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.373755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.373817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.374032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.374589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.374589] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd340134-695f-48b3-a926-eb4ab043b853 is going to be updated. [ 668.402970] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.402970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.402970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.402970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.403253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.403253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd340134-695f-48b3-a926-eb4ab043b853" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.463950] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.463950] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.464210] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.464896] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.464896] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.464896] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.464896] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.466544] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.466966] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.467271] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.467823] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 668.467823] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 668.468032] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 668.468695] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 668.469203] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 668.469203] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 668.474539] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a59199eb-cd75-4610-bbc0-c9b9db1a8478 [ 668.474873] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.474873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.475025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.475225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.475316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.475412] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a59199eb-cd75-4610-bbc0-c9b9db1a8478 already deleted. [ 668.475509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a59199eb-cd75-4610-bbc0-c9b9db1a8478" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.476485] env[65106]: INFO networking_nsxv3.common.synchronization [None req-096efcdf-494d-489b-9e53-30b545335d5e None None] Enqueued Resource ID: e17fbd06-a590-4fd9-8419-d7d777cf7515 with Priority: HIGHEST for action port [ 668.478066] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e17fbd06-a590-4fd9-8419-d7d777cf7515 with Priority: HIGHEST for action port [ 668.478386] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-e17fbd06-a590-4fd9-8419-d7d777cf7515 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.478513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e17fbd06-a590-4fd9-8419-d7d777cf7515" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.478607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e17fbd06-a590-4fd9-8419-d7d777cf7515" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.479103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e17fbd06-a590-4fd9-8419-d7d777cf7515" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.479103] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e17fbd06-a590-4fd9-8419-d7d777cf7515',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.631510] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 668.631672] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.163 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 668.631802] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 668.632028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.632333] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-55a0326d-33c2-40cf-a269-7580ef197459 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.632522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-55a0326d-33c2-40cf-a269-7580ef197459" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.632635] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-55a0326d-33c2-40cf-a269-7580ef197459" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.632983] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-55a0326d-33c2-40cf-a269-7580ef197459" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.633146] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55a0326d-33c2-40cf-a269-7580ef197459',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.635756] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.646074] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 668.646453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.746173] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.746173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.746173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.746503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.746538] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.746699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.746699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.746809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.747044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.747044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.747167] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.747235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.747235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.747367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.747497] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.747576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.747628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.747759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.748036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.748036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.748036] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.749219] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.749327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.749389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.749585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.749665] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.749750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.749806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.749957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.751051] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.751051] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.751051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.753565] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.877103] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.138151] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e17fbd06-a590-4fd9-8419-d7d777cf7515 [ 669.138151] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.138332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.138332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.138554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.138647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.138817] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e17fbd06-a590-4fd9-8419-d7d777cf7515 already deleted. [ 669.138817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e17fbd06-a590-4fd9-8419-d7d777cf7515" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.139204] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.139351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.139443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.139584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.139657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.139803] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 669.141621] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.141815] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.141966] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.142205] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.142411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.142489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 55a0326d-33c2-40cf-a269-7580ef197459 not found, creating... [ 669.142706] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.143137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.143265] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.143455] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.143580] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.143860] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.144065] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.144181] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.144526] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.144699] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.144818] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 55a0326d-33c2-40cf-a269-7580ef197459 is going to be created. [ 669.182353] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.182617] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.182792] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.183195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.183416] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.183650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-55a0326d-33c2-40cf-a269-7580ef197459" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.185370] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.185496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.185564] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.185758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.186061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.198021] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 669.254633] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143c4b09-e4ef-4609-8ff0-863f1dce9402: rpc.has_security_group_logging(os_id): False [ 669.254769] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5872a413-0244-4425-a9f8-dd282f886327: rpc.has_security_group_logging(os_id): False [ 669.297034] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.297034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.297034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.297034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.297034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.297034] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.297034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.297034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.297034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.298308] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.298677] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.298677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.298811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.298945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.299118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.299234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.299424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.299424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.299626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.299626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.299800] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5872a413-0244-4425-a9f8-dd282f886327 is going to be created. [ 669.301708] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.301955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.301955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.302410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.302410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.302601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.304050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.304050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.304050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.305328] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 669.380091] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.382222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.382222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.382222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.382222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.382222] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be created. [ 669.409021] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.409021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.409021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.409267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.409348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.411362] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.411509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.411778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.411778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.411901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.434215] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.434215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.434215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.434215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.434215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.438688] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: UNINITIALIZED for 2s [ 669.438688] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: IN_PROGRESS for 2s [ 669.470430] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 669.784955] env[65106]: INFO networking_nsxv3.common.synchronization [req-0ee8d8f9-0ba3-40f7-9ad9-b7a8ad21645a req-6c8c6931-187a-40b9-bf5d-b58a31489f6a service nova] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_rules [ 669.785223] env[65106]: INFO networking_nsxv3.common.synchronization [req-0ee8d8f9-0ba3-40f7-9ad9-b7a8ad21645a req-6c8c6931-187a-40b9-bf5d-b58a31489f6a service nova] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 669.785223] env[65106]: INFO networking_nsxv3.common.synchronization [req-0ee8d8f9-0ba3-40f7-9ad9-b7a8ad21645a req-6c8c6931-187a-40b9-bf5d-b58a31489f6a service nova] Enqueued Resource ID: 55a0326d-33c2-40cf-a269-7580ef197459 with Priority: HIGHEST for action port [ 669.785717] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_rules [ 669.786590] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 669.786590] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55a0326d-33c2-40cf-a269-7580ef197459 with Priority: HIGHEST for action port [ 669.786940] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.787085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.787152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.787426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.787500] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.789341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.789341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.789341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-55a0326d-33c2-40cf-a269-7580ef197459 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.789341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55a0326d-33c2-40cf-a269-7580ef197459" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.789341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55a0326d-33c2-40cf-a269-7580ef197459" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.789582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55a0326d-33c2-40cf-a269-7580ef197459" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.789582] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55a0326d-33c2-40cf-a269-7580ef197459',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.882238] env[65106]: INFO networking_nsxv3.common.synchronization [req-32010526-e296-4fab-bbdd-04ac6206ccf6 req-72ef46d0-d9da-4cbe-b4bb-b01394de394c tempest-DeleteServersAdminTestJSON-453191217 tempest-DeleteServersAdminTestJSON-453191217-project-member] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 669.882770] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 669.883386] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.883386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.883386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.883575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.883801] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.883905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.883964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.884134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.884257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.884609] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.264336] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.265051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.265051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.265051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.265237] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.265306] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.265420] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.265626] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.265760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.265957] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.266074] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 670.266173] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 670.266270] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 670.266368] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 670.266461] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 670.266581] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 670.295576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.295900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.296710] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55a0326d-33c2-40cf-a269-7580ef197459 with status ACTIVE [ 670.296952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.297218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.297331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.297644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.297736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.297942] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.298100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.298226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.298409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.298409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.298409] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.298409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.298409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.298409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.299389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.299389] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55a0326d-33c2-40cf-a269-7580ef197459 is going to be updated. [ 670.301118] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 670.301561] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 670.301702] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 670.301923] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.302235] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.302513] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.302647] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.303011] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.303254] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecea1995-6313-48a6-9d7d-5d8d292ae0f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.337134] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.337306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.337352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.337567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.337706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.337859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55a0326d-33c2-40cf-a269-7580ef197459" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.387504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.387882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.390968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.390968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.390968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.390968] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.390968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.390968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.390968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.390968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.390968] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 is going to be updated. [ 670.419289] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.419408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.419408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.419607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.419801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.434501] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: IN_PROGRESS for 2s [ 670.526012] env[65106]: INFO networking_nsxv3.common.synchronization [req-3ecc7458-7479-43de-923d-b4440df1eff6 req-33eb2f92-c8c2-4704-b67b-a407a3a9f05f tempest-MultipleCreateTestJSON-2038244732 tempest-MultipleCreateTestJSON-2038244732-project-member] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 670.526701] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 670.526997] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.527351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.527451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.528500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.528500] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.528500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.528500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.528500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.528500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.528500] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.806013] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.806381] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.806381] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.807118] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.807118] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.807118] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port ecea1995-6313-48a6-9d7d-5d8d292ae0f3 not found, creating... [ 670.807314] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.807314] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.807421] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.807744] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.807744] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.807990] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.808158] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.808264] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.808457] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.808577] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.808702] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: ecea1995-6313-48a6-9d7d-5d8d292ae0f3 is going to be created. [ 670.830968] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.831237] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.831368] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.831654] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.832028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.832198] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.031432] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.034973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.034973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.034973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.034973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.034973] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.034973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.034973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.034973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.034973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.034973] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 671.069239] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.069239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.069435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.070137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.070137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.081089] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 671.208804] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 671.209063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.209238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.209455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.209635] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.209746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.209853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.209993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.210084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.210180] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.450954] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: SUCCESS [ 671.451328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.451618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.451952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.452290] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.452534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.452685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.454321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.454321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.454321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.454321] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.455742] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: SUCCESS [ 671.455742] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.457867] env[65106]: INFO networking_nsxv3.common.synchronization [None req-05f8a819-a54f-4b53-9935-726dfda2fe83 None None] Enqueued Resource ID: 7949f218-71ca-4089-8fa7-4e2bbfb85071 with Priority: HIGHEST for action port [ 671.458381] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7949f218-71ca-4089-8fa7-4e2bbfb85071 with Priority: HIGHEST for action port [ 671.458693] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7949f218-71ca-4089-8fa7-4e2bbfb85071 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.458823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7949f218-71ca-4089-8fa7-4e2bbfb85071" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.458906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7949f218-71ca-4089-8fa7-4e2bbfb85071" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.459124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7949f218-71ca-4089-8fa7-4e2bbfb85071" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.459207] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7949f218-71ca-4089-8fa7-4e2bbfb85071',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.489843] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 671.490196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.524214] env[65106]: INFO networking_nsxv3.common.synchronization [req-32010526-e296-4fab-bbdd-04ac6206ccf6 req-58daa0ab-c19b-4b49-9247-b59d39d95cda service nova] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_rules [ 671.524351] env[65106]: INFO networking_nsxv3.common.synchronization [req-32010526-e296-4fab-bbdd-04ac6206ccf6 req-58daa0ab-c19b-4b49-9247-b59d39d95cda service nova] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 671.524519] env[65106]: INFO networking_nsxv3.common.synchronization [req-32010526-e296-4fab-bbdd-04ac6206ccf6 req-58daa0ab-c19b-4b49-9247-b59d39d95cda service nova] Enqueued Resource ID: ecea1995-6313-48a6-9d7d-5d8d292ae0f3 with Priority: HIGHEST for action port [ 671.525014] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_rules [ 671.525408] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 671.525518] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ecea1995-6313-48a6-9d7d-5d8d292ae0f3 with Priority: HIGHEST for action port [ 671.525888] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.525973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.526075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.526352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.526491] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.528184] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.528184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.528406] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.528528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.528639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.528865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.528947] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ecea1995-6313-48a6-9d7d-5d8d292ae0f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.646915] env[65106]: INFO networking_nsxv3.common.synchronization [req-2b1ef9af-f213-4db2-a46e-2d9492607ab6 req-ca002c34-5eff-41ea-9de6-3eadcddcebe4 tempest-SecurityGroupRulesTestJSON-2091241041 tempest-SecurityGroupRulesTestJSON-2091241041-project-member] Enqueued Resource ID: e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865 with Priority: HIGHEST for action security_group_rules [ 671.647229] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865 with Priority: HIGHEST for action security_group_rules [ 671.647587] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.647758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.647862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.648203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.648335] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.712811] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.958187] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.958533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.958533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.958659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.958838] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.958954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.959028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.959201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.959293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.960248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.960248] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.960248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.960248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.960248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.960248] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.960248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.960248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.960248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.960636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.960636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.960636] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.964062] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7949f218-71ca-4089-8fa7-4e2bbfb85071 [ 671.964279] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.964411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.964477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.964693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.964788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.964897] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7949f218-71ca-4089-8fa7-4e2bbfb85071 already deleted. [ 671.964993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7949f218-71ca-4089-8fa7-4e2bbfb85071" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.031522] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.031625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.031787] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ecea1995-6313-48a6-9d7d-5d8d292ae0f3 with status ACTIVE [ 672.031981] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.032105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.032174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.032384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.032470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.032635] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.032728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.032802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.032992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.033119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.033338] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.033452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.033532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.033694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.033781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.033866] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ecea1995-6313-48a6-9d7d-5d8d292ae0f3 is going to be updated. [ 672.062745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.062955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.063064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.063295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.063424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.063596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ecea1995-6313-48a6-9d7d-5d8d292ae0f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.169263] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.169375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.169429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.169723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.169920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.170053] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865 already deleted. [ 672.170146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7e2f0e0-6f06-4b0a-9c0f-545d8e4ce865" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.218922] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.447172] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: SUCCESS [ 672.447433] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 deletion is rescheduled due to dependency. [ 672.447578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.447787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.448095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.448336] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.448485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.448572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.448762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.448865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.448988] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.466838] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d3d6dc0-48cf-4703-a02e-4166d71fd73a: rpc.has_security_group_logging(os_id): False [ 672.486118] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.486273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.486319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.486524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.486612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.486822] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.486922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.486985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.487147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.487227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.487705] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.487794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.487794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.487948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.488031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.488210] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.488301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.488361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.488510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.488560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.488645] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be created. [ 672.546826] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.546990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.547049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.547253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.547430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.563525] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: IN_PROGRESS for 2s [ 672.740634] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.740634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.740634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.740634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.740634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.740634] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 672.758919] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.758919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.758919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.758919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.758919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.788132] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 672.953848] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.096073] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 673.096631] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 deletion is rescheduled due to dependency. [ 673.096631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.459433] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.963330] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.963330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.963330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.963703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.963703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.963703] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 is going to be updated. [ 673.998379] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.998513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.998513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.998740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.998851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.009207] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: IN_PROGRESS for 2s [ 674.083054] env[65106]: INFO networking_nsxv3.common.synchronization [req-0d6b1a19-7763-4e23-89a2-93809f079e11 req-7dbd6e3a-2955-4d86-bc8b-5f9ef4af2afa tempest-ListImageFiltersTestJSON-1907947682 tempest-ListImageFiltersTestJSON-1907947682-project-member] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 674.083328] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 674.083698] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.083839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.083928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.084911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.084911] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.084911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.084911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.085210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.085293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.085584] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.470766] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.471188] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.471188] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.471343] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.471593] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.471746] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.471842] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.472522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.472709] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.472918] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.473058] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.473175] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.473277] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.473380] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.473480] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.473606] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.497493] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.497644] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.497775] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.497947] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.498418] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-1f7fcc36-f5bc-413e-81c0-baecbb45f225 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.498609] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-1f7fcc36-f5bc-413e-81c0-baecbb45f225" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.498727] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-1f7fcc36-f5bc-413e-81c0-baecbb45f225" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.499104] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-1f7fcc36-f5bc-413e-81c0-baecbb45f225" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.499208] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f7fcc36-f5bc-413e-81c0-baecbb45f225',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.588931] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.595699] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: SUCCESS [ 674.595910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.797923] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 674.798747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.798747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.799184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.799184] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.799416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.799974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.799974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.799974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.799974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.800165] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.003418] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.003746] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.003956] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.004485] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.004703] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.004912] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 1f7fcc36-f5bc-413e-81c0-baecbb45f225 not found, creating... [ 675.005307] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.005530] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.005688] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.006067] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.006389] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.006963] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.007102] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.007185] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.007436] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.007596] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.007844] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 1f7fcc36-f5bc-413e-81c0-baecbb45f225 is going to be created. [ 675.035030] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.035270] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.036783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.036783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.036783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.036783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-1f7fcc36-f5bc-413e-81c0-baecbb45f225" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.091706] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.303928] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.304382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.304382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.304382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.304599] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.304599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.304740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.304796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.305579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.305579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.305579] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.305579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.305579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.305579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.305579] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.306099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.306099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.306099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.306099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.306099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.306099] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.594355] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.594355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.594931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.594931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.594931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.594931] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be updated. [ 675.628008] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.628146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.628198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.628408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.628550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.638227] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: IN_PROGRESS for 2s [ 675.776664] env[65106]: INFO networking_nsxv3.common.synchronization [req-0d6b1a19-7763-4e23-89a2-93809f079e11 req-ecf25147-0369-49a9-b782-bb8d0d206126 service nova] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_rules [ 675.776664] env[65106]: INFO networking_nsxv3.common.synchronization [req-0d6b1a19-7763-4e23-89a2-93809f079e11 req-ecf25147-0369-49a9-b782-bb8d0d206126 service nova] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 675.776664] env[65106]: INFO networking_nsxv3.common.synchronization [req-0d6b1a19-7763-4e23-89a2-93809f079e11 req-ecf25147-0369-49a9-b782-bb8d0d206126 service nova] Enqueued Resource ID: 1f7fcc36-f5bc-413e-81c0-baecbb45f225 with Priority: HIGHEST for action port [ 675.777923] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_rules [ 675.777923] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 675.777923] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f7fcc36-f5bc-413e-81c0-baecbb45f225 with Priority: HIGHEST for action port [ 675.778214] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.778370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.778462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.778725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.778860] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.780412] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.780412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.780412] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f7fcc36-f5bc-413e-81c0-baecbb45f225 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.780412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f7fcc36-f5bc-413e-81c0-baecbb45f225" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.780412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f7fcc36-f5bc-413e-81c0-baecbb45f225" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.782237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f7fcc36-f5bc-413e-81c0-baecbb45f225" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.782237] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f7fcc36-f5bc-413e-81c0-baecbb45f225',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.811099] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f58b21a0-a1cb-4daa-9136-8c66dc9641d3: rpc.has_security_group_logging(os_id): False [ 675.835487] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.835487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.836161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.836472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.836596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.836938] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.837114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.837114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.837488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.837488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.837615] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.837715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.837804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.838008] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.838125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.838442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.838548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.838591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.838715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.838820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.838918] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 675.910023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.910293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.910293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.910549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.910747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.940402] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 676.026027] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: SUCCESS [ 676.026027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.026027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.026027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.026027] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.026449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.026449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.026449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.026449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.026630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.026630] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.283796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.284051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.284133] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f7fcc36-f5bc-413e-81c0-baecbb45f225 with status ACTIVE [ 676.285069] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.285069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.285069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.285069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.285069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.285069] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.285069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.285069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.285548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.285548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.285548] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.285675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.285675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.285830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.285887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.285940] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f7fcc36-f5bc-413e-81c0-baecbb45f225 is going to be updated. [ 676.323709] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.323709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.323709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.324285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.324285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.324285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f7fcc36-f5bc-413e-81c0-baecbb45f225" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.533478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.533478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.533478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.533478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.533478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.534214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.534214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.534214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.534214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.534214] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.671583] env[65106]: INFO networking_nsxv3.common.synchronization [req-795e84f6-fe88-43a2-8944-bf1440e931e7 req-32b7f789-da76-41f4-ba8a-4c2817ee777c tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 676.672317] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 676.672693] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.672924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.673046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.673235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.673411] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.673535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.673621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.673848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.673967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.674111] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.037280] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 416df7e5-52a8-484d-a488-4f4f2380f0a6: rpc.has_security_group_logging(os_id): False [ 677.066022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.066022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.066022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.066022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.070982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.070982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.070982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.070982] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.070982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.070982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.070982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.070982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.070982] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 is going to be updated. [ 677.173509] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.175592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.175592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.175592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.176482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.178106] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.178686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.178686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.179556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.179556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.179714] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.180041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.181408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.181408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.181408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.181408] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 677.204286] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: IN_PROGRESS for 2s [ 677.221670] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.222042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.222042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.222239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.222405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.235052] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 677.651355] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: SUCCESS [ 677.652278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.652278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.652278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.652589] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.652589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.652850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.652850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.652922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.653074] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.958515] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 677.958980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.158939] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.416773] env[65106]: INFO networking_nsxv3.common.synchronization [req-54c6b657-4506-43d2-9c27-51070d972f2c req-31b746a7-a078-469e-be5f-49b554976b91 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 678.417481] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 678.417827] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.417948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.418052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.418362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.419591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.419704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.419755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.419946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.420044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.420160] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.663302] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.853658] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.853994] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.855741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.855741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.856138] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.856511] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.858965] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.858965] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.858965] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.858965] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.858965] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 678.858965] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 678.858965] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 678.858965] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 678.858965] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 678.858965] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 678.886151] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 678.886151] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 678.886151] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 678.886151] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.886151] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-fa5be814-2170-4ceb-ba68-88a5e6ef075c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.886151] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-fa5be814-2170-4ceb-ba68-88a5e6ef075c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.886151] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-fa5be814-2170-4ceb-ba68-88a5e6ef075c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.886637] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-fa5be814-2170-4ceb-ba68-88a5e6ef075c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.886778] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa5be814-2170-4ceb-ba68-88a5e6ef075c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.923265] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.923484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.923484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.923672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.923800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.923992] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.924123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.924486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.924486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.924564] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.924597] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 already deleted. [ 678.924672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.166501] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.166894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.166894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.167044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.167174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.167312] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be updated. [ 679.197888] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.197888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.198166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.198207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.198388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.211165] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: IN_PROGRESS for 2s [ 679.216606] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: SUCCESS [ 679.216872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.245893] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 4s [ 679.389030] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.389479] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.389479] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.389925] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.390183] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.390423] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port fa5be814-2170-4ceb-ba68-88a5e6ef075c not found, creating... [ 679.390811] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.391085] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.391272] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.391691] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.391797] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.392263] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.392505] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.392703] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.392993] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.393244] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.393451] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: fa5be814-2170-4ceb-ba68-88a5e6ef075c is going to be created. [ 679.419415] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.419687] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.419852] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.420181] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.420413] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.420671] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-fa5be814-2170-4ceb-ba68-88a5e6ef075c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.134568] env[65106]: INFO networking_nsxv3.common.synchronization [req-54c6b657-4506-43d2-9c27-51070d972f2c req-604088ed-2d87-422f-9388-3f14c94a9979 service nova] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 680.135366] env[65106]: INFO networking_nsxv3.common.synchronization [req-54c6b657-4506-43d2-9c27-51070d972f2c req-604088ed-2d87-422f-9388-3f14c94a9979 service nova] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 680.135366] env[65106]: INFO networking_nsxv3.common.synchronization [req-54c6b657-4506-43d2-9c27-51070d972f2c req-604088ed-2d87-422f-9388-3f14c94a9979 service nova] Enqueued Resource ID: fa5be814-2170-4ceb-ba68-88a5e6ef075c with Priority: HIGHEST for action port [ 680.135805] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 680.135983] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 680.136140] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa5be814-2170-4ceb-ba68-88a5e6ef075c with Priority: HIGHEST for action port [ 680.136486] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.136657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.136748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.137109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.137158] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.138261] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.138404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.138517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.138729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.139127] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.139127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.139127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.139314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.139422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.139542] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.141162] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa5be814-2170-4ceb-ba68-88a5e6ef075c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.141235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa5be814-2170-4ceb-ba68-88a5e6ef075c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.141336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa5be814-2170-4ceb-ba68-88a5e6ef075c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.142517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa5be814-2170-4ceb-ba68-88a5e6ef075c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.142517] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa5be814-2170-4ceb-ba68-88a5e6ef075c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.647646] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.647646] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.647646] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa5be814-2170-4ceb-ba68-88a5e6ef075c with status ACTIVE [ 680.647646] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.647646] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.647646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.648586] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.648586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.648586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.648586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.648586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.648586] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa5be814-2170-4ceb-ba68-88a5e6ef075c is going to be updated. [ 680.669647] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.669822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.669914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.670158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.670310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.670484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa5be814-2170-4ceb-ba68-88a5e6ef075c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.150918] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.224293] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: SUCCESS [ 681.224293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.224293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.224293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.224293] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.224293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.224293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.224293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.224293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.224293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.224293] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.257675] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 681.257675] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 deletion is rescheduled due to dependency. [ 681.257675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.652364] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.658394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.658394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.658394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.658394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.658394] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be created. [ 681.686024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.686024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.686024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.686365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.686365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.698439] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: UNINITIALIZED for 2s [ 681.727582] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.727582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.727582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.727582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.727582] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.727582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.727582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.727582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.729144] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.729144] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.729144] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.110553] env[65106]: INFO networking_nsxv3.common.synchronization [None req-8dd2346e-8a50-4670-a713-736b288ed5a2 None None] Enqueued Resource ID: 63cfaa7a-9150-41fb-84e9-39d97382574a with Priority: HIGHEST for action port [ 682.110553] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63cfaa7a-9150-41fb-84e9-39d97382574a with Priority: HIGHEST for action port [ 682.110553] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-63cfaa7a-9150-41fb-84e9-39d97382574a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.110553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63cfaa7a-9150-41fb-84e9-39d97382574a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.110553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63cfaa7a-9150-41fb-84e9-39d97382574a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.110553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63cfaa7a-9150-41fb-84e9-39d97382574a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.110553] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63cfaa7a-9150-41fb-84e9-39d97382574a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.236461] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d3d6dc0-48cf-4703-a02e-4166d71fd73a: rpc.has_security_group_logging(os_id): False [ 682.271425] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.271892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.271892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.272059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.272059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.272329] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.272433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.273035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.273035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.273035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.273035] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.273982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.274692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.274982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.275144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.276437] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.276437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.276437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.276437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.276437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.276437] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be updated. [ 682.375512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.376653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.376653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.376653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.376653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.382439] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ea75a3dd-5d35-4b86-8269-a10c1bd03eb7 None None] Enqueued Resource ID: 9a69eee8-ac70-426f-8e88-e7eb80da258a with Priority: HIGHEST for action port [ 682.383317] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a69eee8-ac70-426f-8e88-e7eb80da258a with Priority: HIGHEST for action port [ 682.383680] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a69eee8-ac70-426f-8e88-e7eb80da258a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.383861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a69eee8-ac70-426f-8e88-e7eb80da258a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.384181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a69eee8-ac70-426f-8e88-e7eb80da258a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.384255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a69eee8-ac70-426f-8e88-e7eb80da258a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.384406] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a69eee8-ac70-426f-8e88-e7eb80da258a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.393701] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: IN_PROGRESS for 2s [ 682.615248] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63cfaa7a-9150-41fb-84e9-39d97382574a [ 682.615248] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.615248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.615248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.615461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.615782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.615782] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63cfaa7a-9150-41fb-84e9-39d97382574a already deleted. [ 682.615782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63cfaa7a-9150-41fb-84e9-39d97382574a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.886396] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a69eee8-ac70-426f-8e88-e7eb80da258a [ 682.886785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.886952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.886999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.887624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.887721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.887817] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a69eee8-ac70-426f-8e88-e7eb80da258a already deleted. [ 682.887894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a69eee8-ac70-426f-8e88-e7eb80da258a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.428150] env[65106]: INFO networking_nsxv3.common.synchronization [req-530ea883-c0f0-4cd1-bbff-e1db4caac8f9 req-b81ce8b0-5172-4a1b-b281-7700f541143b tempest-SecurityGroupRulesTestJSON-2091241041 tempest-SecurityGroupRulesTestJSON-2091241041-project-member] Enqueued Resource ID: d7bd8790-df95-4b90-a56f-5fa28b92849c with Priority: HIGHEST for action security_group_rules [ 683.428150] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7bd8790-df95-4b90-a56f-5fa28b92849c with Priority: HIGHEST for action security_group_rules [ 683.428150] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7bd8790-df95-4b90-a56f-5fa28b92849c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.428150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7bd8790-df95-4b90-a56f-5fa28b92849c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.428150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7bd8790-df95-4b90-a56f-5fa28b92849c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.428150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7bd8790-df95-4b90-a56f-5fa28b92849c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.428536] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7bd8790-df95-4b90-a56f-5fa28b92849c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.710075] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 683.712108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.712108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.712108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.712108] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.712108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.712108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.712108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.712626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.712626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.712626] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.957859] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.958533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.958533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.958533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.958533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.958799] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7bd8790-df95-4b90-a56f-5fa28b92849c already deleted. [ 683.958799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7bd8790-df95-4b90-a56f-5fa28b92849c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.146880] env[65106]: INFO networking_nsxv3.common.synchronization [None req-f020eedb-52e1-43db-8dba-f5e4b33d0416 None None] Enqueued Resource ID: 7ce22fa6-655c-40af-8c54-ba192e54e160 with Priority: HIGHEST for action port [ 684.146880] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ce22fa6-655c-40af-8c54-ba192e54e160 with Priority: HIGHEST for action port [ 684.146880] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ce22fa6-655c-40af-8c54-ba192e54e160 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.147248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ce22fa6-655c-40af-8c54-ba192e54e160" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.147248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ce22fa6-655c-40af-8c54-ba192e54e160" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.147324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ce22fa6-655c-40af-8c54-ba192e54e160" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.147360] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ce22fa6-655c-40af-8c54-ba192e54e160',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.216086] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.414572] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: SUCCESS [ 684.414849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.653834] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ce22fa6-655c-40af-8c54-ba192e54e160 [ 684.654224] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.654485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.654640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.654954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.655170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.655369] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ce22fa6-655c-40af-8c54-ba192e54e160 already deleted. [ 684.655542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ce22fa6-655c-40af-8c54-ba192e54e160" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.717583] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8e3138f-71fe-44de-b062-382436a9dc63: rpc.has_security_group_logging(os_id): False [ 684.745708] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.745851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.746348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.746348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.746348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.746517] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.746669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.746669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.746736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.747452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.747452] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be created. [ 684.814735] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.814986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.815134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.815759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.815759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.833017] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 685.449388] env[65106]: INFO networking_nsxv3.common.synchronization [None req-18eeaf0a-7d0b-4fa8-b3a5-c505ad4e1d98 tempest-AttachVolumeShelveTestJSON-512943003 tempest-AttachVolumeShelveTestJSON-512943003-project-member] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_rules [ 685.450752] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_rules [ 685.451200] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.451337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.451401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.451689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.451776] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.587739] env[65106]: INFO networking_nsxv3.common.synchronization [None req-9ec250db-8fc2-4d24-8457-f7053019e25b tempest-AttachVolumeShelveTestJSON-512943003 tempest-AttachVolumeShelveTestJSON-512943003-project-member] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_rules [ 685.588343] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_rules [ 685.588653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.588751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.995637] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.995882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.995882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.996080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.996149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.996235] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 already deleted. [ 685.996319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.996488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.996842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.996842] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.106962] env[65106]: INFO networking_nsxv3.common.synchronization [None req-a7898435-f7cf-41e2-9c24-ae86537920b9 None None] Enqueued Resource ID: a5471ed7-9433-428c-a621-64b8fc84f8ac with Priority: HIGHEST for action port [ 686.108476] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5471ed7-9433-428c-a621-64b8fc84f8ac with Priority: HIGHEST for action port [ 686.109818] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5471ed7-9433-428c-a621-64b8fc84f8ac taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.109818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5471ed7-9433-428c-a621-64b8fc84f8ac" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.109818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5471ed7-9433-428c-a621-64b8fc84f8ac" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.110048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5471ed7-9433-428c-a621-64b8fc84f8ac" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.111205] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5471ed7-9433-428c-a621-64b8fc84f8ac',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.127808] env[65106]: INFO networking_nsxv3.common.synchronization [None req-370f8b3a-d359-4106-9cb8-24428df524d2 None None] Enqueued Resource ID: a50419eb-21d8-42fe-8abe-758e4983c655 with Priority: HIGHEST for action port [ 686.128387] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a50419eb-21d8-42fe-8abe-758e4983c655 with Priority: HIGHEST for action port [ 686.128695] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a50419eb-21d8-42fe-8abe-758e4983c655 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.128817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a50419eb-21d8-42fe-8abe-758e4983c655" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.128882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a50419eb-21d8-42fe-8abe-758e4983c655" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.129164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a50419eb-21d8-42fe-8abe-758e4983c655" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.129252] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a50419eb-21d8-42fe-8abe-758e4983c655',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.531236] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.531236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.531236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.531236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.531236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.531236] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 already deleted. [ 686.531236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.613389] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5471ed7-9433-428c-a621-64b8fc84f8ac [ 686.614089] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.614089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.614089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.614089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.614285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.614285] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5471ed7-9433-428c-a621-64b8fc84f8ac already deleted. [ 686.614285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5471ed7-9433-428c-a621-64b8fc84f8ac" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.632433] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a50419eb-21d8-42fe-8abe-758e4983c655 [ 686.632433] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.632433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.632433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.632433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.632433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.632433] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a50419eb-21d8-42fe-8abe-758e4983c655 already deleted. [ 686.632433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a50419eb-21d8-42fe-8abe-758e4983c655" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.848445] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 686.848677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.438154] env[65106]: INFO networking_nsxv3.common.synchronization [req-698a24e7-3b87-4a38-aaef-ba8c81b6f19c req-bc4fe47c-d713-45e5-9839-86a76a3c2656 tempest-VolumesAdminNegativeTest-2004313853 tempest-VolumesAdminNegativeTest-2004313853-project-member] Enqueued Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGHEST for action security_group_members [ 688.438717] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGHEST for action security_group_members [ 688.440759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a7c51f-690b-43e1-a214-2196c4632ae4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.440759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.440759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.440759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.440759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.440759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.440759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.440759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.440759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.441378] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.718206] env[65106]: INFO networking_nsxv3.common.synchronization [None req-80423e71-3db9-44a4-a121-1e7e14279fb9 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 688.718822] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 688.719179] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.719274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.719360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.719711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.719711] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.913038] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.913038] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-119" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.913038] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-119" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.913038] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-119" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.913038] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.913038] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.913038] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.913038] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.913038] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.913038] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.913713] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.913973] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.914240] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.914470] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.914670] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.914936] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.939943] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.940636] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 688.941077] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.941321] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-119" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.941670] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-de5654b2-4ff0-4442-a882-ac2f9a186946 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.941845] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-de5654b2-4ff0-4442-a882-ac2f9a186946" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.941960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-de5654b2-4ff0-4442-a882-ac2f9a186946" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.942398] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-de5654b2-4ff0-4442-a882-ac2f9a186946" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.942539] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de5654b2-4ff0-4442-a882-ac2f9a186946',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.943614] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.943881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.943989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.944318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.944511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.944820] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.945019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.945120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.945324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.945424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.945536] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 already deleted. [ 688.945635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.963933] env[65106]: INFO networking_nsxv3.common.synchronization [None req-46bdb7a5-3261-4511-b672-a3a93575f434 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 688.964591] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 688.964877] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.964989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.972419] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ca652106-f3af-4cb5-9a39-942f2f163472 None None] Enqueued Resource ID: b0d5a71c-1c13-445d-ad2c-edaeb6ed38de with Priority: HIGHEST for action port [ 688.976429] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0d5a71c-1c13-445d-ad2c-edaeb6ed38de with Priority: HIGHEST for action port [ 688.976429] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0d5a71c-1c13-445d-ad2c-edaeb6ed38de taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.976429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0d5a71c-1c13-445d-ad2c-edaeb6ed38de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.976429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0d5a71c-1c13-445d-ad2c-edaeb6ed38de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.976429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0d5a71c-1c13-445d-ad2c-edaeb6ed38de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.976429] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0d5a71c-1c13-445d-ad2c-edaeb6ed38de',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.243420] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.243579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.243630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.243907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.244063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.244063] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d already deleted. [ 689.244218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.244297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.244508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.244610] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.447725] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.448085] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.448254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.448711] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.448945] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.449210] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port de5654b2-4ff0-4442-a882-ac2f9a186946 not found, creating... [ 689.450197] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.450324] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.450555] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.450776] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.450990] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.451453] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.451738] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.451854] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.452191] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.452437] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.452671] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: de5654b2-4ff0-4442-a882-ac2f9a186946 is going to be created. [ 689.475906] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.476097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.476479] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.476623] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.477013] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.477386] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-de5654b2-4ff0-4442-a882-ac2f9a186946" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.478890] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0d5a71c-1c13-445d-ad2c-edaeb6ed38de [ 689.478987] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.479191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.479289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.481203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.481203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.481203] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0d5a71c-1c13-445d-ad2c-edaeb6ed38de already deleted. [ 689.481203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0d5a71c-1c13-445d-ad2c-edaeb6ed38de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.767414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.767549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.767606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.768095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.768095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.768169] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d already deleted. [ 689.768243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.233869] env[65106]: INFO networking_nsxv3.common.synchronization [req-698a24e7-3b87-4a38-aaef-ba8c81b6f19c req-b9a2f6a6-8479-4091-988a-6ee834899bea service nova] Enqueued Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGHEST for action security_group_rules [ 690.234061] env[65106]: INFO networking_nsxv3.common.synchronization [req-698a24e7-3b87-4a38-aaef-ba8c81b6f19c req-b9a2f6a6-8479-4091-988a-6ee834899bea service nova] Enqueued Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGHEST for action security_group_members [ 690.234194] env[65106]: INFO networking_nsxv3.common.synchronization [req-698a24e7-3b87-4a38-aaef-ba8c81b6f19c req-b9a2f6a6-8479-4091-988a-6ee834899bea service nova] Enqueued Resource ID: de5654b2-4ff0-4442-a882-ac2f9a186946 with Priority: HIGHEST for action port [ 690.234775] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGHEST for action security_group_rules [ 690.234917] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGHEST for action security_group_members [ 690.238450] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de5654b2-4ff0-4442-a882-ac2f9a186946 with Priority: HIGHEST for action port [ 690.238956] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81a7c51f-690b-43e1-a214-2196c4632ae4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.239634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.239634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.239821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.239909] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.241181] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a7c51f-690b-43e1-a214-2196c4632ae4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.241181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.241181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.241422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.241499] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.241574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.241626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.241835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.241929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.241929] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.245085] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-de5654b2-4ff0-4442-a882-ac2f9a186946 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.245085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de5654b2-4ff0-4442-a882-ac2f9a186946" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.245085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de5654b2-4ff0-4442-a882-ac2f9a186946" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.245310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de5654b2-4ff0-4442-a882-ac2f9a186946" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.245310] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de5654b2-4ff0-4442-a882-ac2f9a186946',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.418641] env[65106]: INFO networking_nsxv3.common.synchronization [req-eac59b37-eac1-4cb4-94cb-40dd657c651a req-6e0ffa0f-f9aa-4fd4-bde6-57e0b0b1f3fe tempest-ImagesOneServerNegativeTestJSON-531782934 tempest-ImagesOneServerNegativeTestJSON-531782934-project-member] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 690.419938] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 690.420344] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.420474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.420541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.420751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.420904] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.421014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.421081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.421231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.421316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.421414] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.571111] env[65106]: INFO networking_nsxv3.common.synchronization [req-35cc9c58-8b92-46f7-80d0-1d3b1fc463f7 req-3cd6583d-bebe-4b3c-a577-19d825677fbc tempest-SecurityGroupRulesTestJSON-2091241041 tempest-SecurityGroupRulesTestJSON-2091241041-project-member] Enqueued Resource ID: 773cfe06-9038-48a6-918a-7f03d6d756ef with Priority: HIGHEST for action security_group_rules [ 690.571662] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 773cfe06-9038-48a6-918a-7f03d6d756ef with Priority: HIGHEST for action security_group_rules [ 690.572274] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-773cfe06-9038-48a6-918a-7f03d6d756ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.576241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-773cfe06-9038-48a6-918a-7f03d6d756ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.576361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-773cfe06-9038-48a6-918a-7f03d6d756ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.576593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-773cfe06-9038-48a6-918a-7f03d6d756ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.576683] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('773cfe06-9038-48a6-918a-7f03d6d756ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.747434] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a7c51f-690b-43e1-a214-2196c4632ae4 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.747557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.749252] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.751015] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de5654b2-4ff0-4442-a882-ac2f9a186946 with status ACTIVE [ 690.751228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.751439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.751825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.751825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.751929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.752206] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.752829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.752829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.752829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.752829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.752829] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.754310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.754310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.754310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.754310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.754310] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de5654b2-4ff0-4442-a882-ac2f9a186946 is going to be updated. [ 690.806991] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.807164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.807300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.808036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.808036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.808036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de5654b2-4ff0-4442-a882-ac2f9a186946" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.926893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.927299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.927794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.928081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.928488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.929897] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.930057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.930209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.930426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.930791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.930940] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 690.989504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.989799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.989799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.989936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.990150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.003903] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 691.099823] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.100016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.100130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.100328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.100444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.100547] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 773cfe06-9038-48a6-918a-7f03d6d756ef already deleted. [ 691.100651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-773cfe06-9038-48a6-918a-7f03d6d756ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.250993] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.574935] env[65106]: INFO networking_nsxv3.common.synchronization [req-d9e0b2fc-6b85-4efa-bae0-a67061d08a1d req-4c0c5268-082f-4b4d-9375-8f3a545bbfee tempest-DeleteServersAdminTestJSON-453191217 tempest-DeleteServersAdminTestJSON-453191217-project-member] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 691.575483] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGHEST for action security_group_members [ 691.576093] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.576229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.576300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.576526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.576679] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.576776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.576838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.576993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.577090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.577182] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.755861] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.756092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.756403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.758028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.758275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.758415] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 is going to be created. [ 691.786946] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.787110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.787175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.787923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.787923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.799182] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 in Status: UNINITIALIZED for 2s [ 692.080281] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.082955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.082955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.082955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.082955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.082955] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.082955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.082955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.082955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.082955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.082955] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 is going to be updated. [ 692.113456] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.113456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.113456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.113456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.113456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.124344] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: IN_PROGRESS for 2s [ 692.513412] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-95dd0c9f-09f4-47db-b637-fc44e94fd2e1 tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 692.514724] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 692.514724] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.514724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.515288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.515288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.515510] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.515634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.518753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.519735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.519735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.519735] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.977724] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-0eab8a4b-c893-4298-9fe0-4cf6790b4479 tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 692.979113] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 692.979747] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.979878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.017557] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 693.018223] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd deletion is rescheduled due to dependency. [ 693.018437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.022780] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.023466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.023594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.023841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.023963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.024186] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.024303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.024397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.024616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.024693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.024778] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e already deleted. [ 693.024863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.025046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.025243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.025422] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.025575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.025575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.025934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.025934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.025934] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.395840] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-0f394ee5-67b8-4596-96e5-11ddcce85d9a tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 693.396807] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 693.397254] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.397397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.530452] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.530452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.530452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.530452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.530452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.530452] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.530452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.530452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.530452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.530452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.530927] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e already deleted. [ 693.530927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.531423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.531588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.531757] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.531864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.531926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.532080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.532293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.532293] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.798584] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.798862] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-305" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.798912] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-305" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.799348] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-305" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.799710] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.800639] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.800639] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.800768] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.800973] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.801837] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.801837] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.801837] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.801837] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.801837] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.801837] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.802042] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.813684] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 in Status: SUCCESS [ 693.813936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.814284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.814581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.815169] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.815169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.815169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.815169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.815379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.815379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.815429] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.826426] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.826426] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.826426] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.827401] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-305" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.827743] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-74a08f5b-f361-4a28-b859-2b68c5cf5a04 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.827918] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-74a08f5b-f361-4a28-b859-2b68c5cf5a04" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.828048] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-74a08f5b-f361-4a28-b859-2b68c5cf5a04" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.828527] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-74a08f5b-f361-4a28-b859-2b68c5cf5a04" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.828869] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a08f5b-f361-4a28-b859-2b68c5cf5a04',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.036965] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.037770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.038094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.040024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.040024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.040024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.040024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.040024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.040024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.040024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.040024] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e already deleted. [ 694.040024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.136501] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 in Status: SUCCESS [ 694.136501] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 deletion is rescheduled due to dependency. [ 694.136501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.317537] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a7c51f-690b-43e1-a214-2196c4632ae4 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.317688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.317768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.318051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.318242] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.318349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.318414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.318582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.318670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.318760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.318906] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a7c51f-690b-43e1-a214-2196c4632ae4 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.318997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.319490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.319490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.319490] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.319490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.319490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.319814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.319814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.319814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.319814] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.333831] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.334067] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.334226] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.334496] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.334649] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.334858] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 74a08f5b-f361-4a28-b859-2b68c5cf5a04 not found, creating... [ 694.335191] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.335398] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.335529] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.335778] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.335913] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.336318] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.336491] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.336580] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.336854] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.337019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.337614] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 74a08f5b-f361-4a28-b859-2b68c5cf5a04 is going to be created. [ 694.362448] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.362679] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.362763] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.363049] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.363324] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.363557] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-74a08f5b-f361-4a28-b859-2b68c5cf5a04" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.822088] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 81a7c51f-690b-43e1-a214-2196c4632ae4: rpc.has_security_group_logging(os_id): False [ 694.848402] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.848584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.848626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.848821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.848959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.849234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.849411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.849465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.849609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.849687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.849892] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.850018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.850140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.850293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.850355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.850535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.850627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.850688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.851333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.851333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.851333] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 is going to be created. [ 694.946325] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.946325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.946668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.946668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.946809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.959925] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 in Status: IN_PROGRESS for 2s [ 695.188481] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-fc6c8f32-9922-4ce8-a2c1-59a83689d661 service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 695.188783] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-fc6c8f32-9922-4ce8-a2c1-59a83689d661 service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 695.188970] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-fc6c8f32-9922-4ce8-a2c1-59a83689d661 service nova] Enqueued Resource ID: 74a08f5b-f361-4a28-b859-2b68c5cf5a04 with Priority: HIGHEST for action port [ 695.189753] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 695.190243] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 695.190786] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74a08f5b-f361-4a28-b859-2b68c5cf5a04 with Priority: HIGHEST for action port [ 695.190786] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.191012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.191040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.191392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.191529] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.193644] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.193644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.193644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.193644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.193772] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.193772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.193830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.194244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.194244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.194244] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.195064] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-74a08f5b-f361-4a28-b859-2b68c5cf5a04 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.196575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74a08f5b-f361-4a28-b859-2b68c5cf5a04" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.196575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74a08f5b-f361-4a28-b859-2b68c5cf5a04" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.196575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74a08f5b-f361-4a28-b859-2b68c5cf5a04" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.196575] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74a08f5b-f361-4a28-b859-2b68c5cf5a04',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.697536] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.699771] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.699930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.700158] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74a08f5b-f361-4a28-b859-2b68c5cf5a04 with status ACTIVE [ 695.700331] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.700486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.700858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.701085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.701532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.701532] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.701532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.701532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.701726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.702472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.702472] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.702607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.702607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.702607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.702607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.702607] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74a08f5b-f361-4a28-b859-2b68c5cf5a04 is going to be updated. [ 695.729745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.730962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.731159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.731456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.731657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.731888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74a08f5b-f361-4a28-b859-2b68c5cf5a04" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.999566] env[65106]: INFO networking_nsxv3.common.synchronization [req-2ad8c595-5d0d-4d3c-9988-b9c63c32d759 req-efa4c996-084b-49e4-92cf-4dd0d6f925bf tempest-ServerTagsTestJSON-133426062 tempest-ServerTagsTestJSON-133426062-project-member] Enqueued Resource ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 with Priority: HIGHEST for action security_group_members [ 695.999927] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 with Priority: HIGHEST for action security_group_members [ 696.000856] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e524fc2-f045-49dd-9b9d-694845e21af8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.000856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.000856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.000856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.000856] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.001197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.001197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.001197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.001311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.001410] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e524fc2-f045-49dd-9b9d-694845e21af8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.205103] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.329684] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-393 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.329930] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-393" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.330146] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-393" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.330387] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-393" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.330645] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.330792] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.330902] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.331405] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.331614] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.331872] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.332035] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 696.332296] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 696.332553] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 696.332699] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 696.332856] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 696.333148] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 696.336875] env[65106]: INFO networking_nsxv3.common.synchronization [None req-bb6a1b85-eed4-4664-95b2-1b1d8a618cd4 None None] Enqueued Resource ID: 6b8fd904-fcf7-4b36-8ea4-64f05506e1eb with Priority: HIGHEST for action port [ 696.337819] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8fd904-fcf7-4b36-8ea4-64f05506e1eb with Priority: HIGHEST for action port [ 696.338203] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b8fd904-fcf7-4b36-8ea4-64f05506e1eb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.338411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b8fd904-fcf7-4b36-8ea4-64f05506e1eb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.338616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b8fd904-fcf7-4b36-8ea4-64f05506e1eb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.338877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b8fd904-fcf7-4b36-8ea4-64f05506e1eb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.339139] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b8fd904-fcf7-4b36-8ea4-64f05506e1eb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.357550] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 696.357713] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 696.357851] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 696.358021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-393" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.358346] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-91afeb98-6e7f-4338-b815-60ad1d452be0 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.358510] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-91afeb98-6e7f-4338-b815-60ad1d452be0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.358619] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-91afeb98-6e7f-4338-b815-60ad1d452be0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.358939] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-91afeb98-6e7f-4338-b815-60ad1d452be0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.359088] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91afeb98-6e7f-4338-b815-60ad1d452be0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.504698] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.504867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.505013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.505172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.505267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.505539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.505683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.506752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.506752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.506752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.506752] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 is going to be updated. [ 696.547158] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.547296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.547388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.547626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.548486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.559834] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 in Status: IN_PROGRESS for 2s [ 696.707677] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.707890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.707954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.708210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.708305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.708414] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be created. [ 696.737788] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.738056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.738056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.738853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.739147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.750076] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: UNINITIALIZED for 2s [ 696.841864] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b8fd904-fcf7-4b36-8ea4-64f05506e1eb [ 696.842196] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.842581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.842744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.843092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.843250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.843406] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b8fd904-fcf7-4b36-8ea4-64f05506e1eb already deleted. [ 696.843542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b8fd904-fcf7-4b36-8ea4-64f05506e1eb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.863704] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.864017] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.864181] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.864688] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.864756] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.864965] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 91afeb98-6e7f-4338-b815-60ad1d452be0 not found, creating... [ 696.865415] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.865696] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.865874] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.866286] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.866444] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.866793] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.866952] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.867077] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.867498] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.867663] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.867806] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 91afeb98-6e7f-4338-b815-60ad1d452be0 is going to be created. [ 696.893356] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.893656] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.893804] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.894080] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.894323] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.894553] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-91afeb98-6e7f-4338-b815-60ad1d452be0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.974309] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 in Status: SUCCESS [ 696.974734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.615275] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-54012809-fea8-48ce-a4d5-4f6846508bf9 service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 697.615557] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-54012809-fea8-48ce-a4d5-4f6846508bf9 service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 697.615592] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-54012809-fea8-48ce-a4d5-4f6846508bf9 service nova] Enqueued Resource ID: 91afeb98-6e7f-4338-b815-60ad1d452be0 with Priority: HIGHEST for action port [ 697.617508] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 697.617508] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 697.617508] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91afeb98-6e7f-4338-b815-60ad1d452be0 with Priority: HIGHEST for action port [ 697.617508] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.617508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.617857] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.617857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.617857] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-91afeb98-6e7f-4338-b815-60ad1d452be0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.617990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91afeb98-6e7f-4338-b815-60ad1d452be0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.617990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91afeb98-6e7f-4338-b815-60ad1d452be0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.618180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91afeb98-6e7f-4338-b815-60ad1d452be0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.618317] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91afeb98-6e7f-4338-b815-60ad1d452be0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.121410] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91afeb98-6e7f-4338-b815-60ad1d452be0 with status ACTIVE [ 698.121568] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.121754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.121831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.122119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.122370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.122597] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.122717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.122791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.123289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.123723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.123723] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.123723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.123905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.123905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.123989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.124956] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91afeb98-6e7f-4338-b815-60ad1d452be0 is going to be updated. [ 698.147655] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.148238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.148238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.148238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.148417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.148463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91afeb98-6e7f-4338-b815-60ad1d452be0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.537196] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-305 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.537466] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-305" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.537544] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-305" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.537987] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-305" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.538308] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.538472] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.538588] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.538948] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.539156] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.539381] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.539491] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.539597] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.539697] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.539802] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.539901] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.540098] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.572941] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.573451] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.573451] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.573613] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-305" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.574074] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-bdab7fab-97ae-46cd-8c05-3478cd419693 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.574335] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-bdab7fab-97ae-46cd-8c05-3478cd419693" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.574537] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-bdab7fab-97ae-46cd-8c05-3478cd419693" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.574903] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-bdab7fab-97ae-46cd-8c05-3478cd419693" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.575094] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdab7fab-97ae-46cd-8c05-3478cd419693',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.577955] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 in Status: SUCCESS [ 698.578846] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e524fc2-f045-49dd-9b9d-694845e21af8 deletion is rescheduled due to dependency. [ 698.578846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e524fc2-f045-49dd-9b9d-694845e21af8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.763549] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 698.763549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.763890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.764158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.764619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.764619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.764778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.765728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.765992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.765992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.766180] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.767248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.767709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.767938] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.768121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.768519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.768519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.768519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.768519] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.833202] env[65106]: INFO networking_nsxv3.common.synchronization [req-46a4916a-efa4-442a-8e1a-84321de838e0 req-6f774f6e-29b7-442a-9d57-edb870cbc2fb tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 698.834461] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 698.834461] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.834461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.834461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.834732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.834732] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.834732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.834849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.834939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.835018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.835108] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.982635] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0c6c9d51-3c4b-4be1-bbad-ae4a3e8cb9ba None None] Enqueued Resource ID: 83cc1abc-b427-4a93-8f7d-49c274572eef with Priority: HIGHEST for action port [ 698.982635] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83cc1abc-b427-4a93-8f7d-49c274572eef with Priority: HIGHEST for action port [ 698.983010] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-83cc1abc-b427-4a93-8f7d-49c274572eef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.984472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83cc1abc-b427-4a93-8f7d-49c274572eef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.984647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83cc1abc-b427-4a93-8f7d-49c274572eef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.984946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83cc1abc-b427-4a93-8f7d-49c274572eef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.985078] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83cc1abc-b427-4a93-8f7d-49c274572eef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.080301] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.080546] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.080667] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.080957] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.081120] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.081285] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port bdab7fab-97ae-46cd-8c05-3478cd419693 not found, creating... [ 699.081582] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.081753] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.081864] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.082109] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.082316] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.082621] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.082776] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.082886] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.083165] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.083569] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.083737] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: bdab7fab-97ae-46cd-8c05-3478cd419693 is going to be created. [ 699.106578] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.106886] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.107028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.107377] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.107614] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.107903] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-bdab7fab-97ae-46cd-8c05-3478cd419693" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.270718] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.270718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.274428] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.337433] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.337508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.337588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.337778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.337862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.338109] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.338384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.338384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.338503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.339041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.339041] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 699.377712] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.377886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.378016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.378283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.378464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.391328] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 699.487495] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83cc1abc-b427-4a93-8f7d-49c274572eef [ 699.487883] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.488199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.488378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.488778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.488778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.489025] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83cc1abc-b427-4a93-8f7d-49c274572eef already deleted. [ 699.489213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83cc1abc-b427-4a93-8f7d-49c274572eef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.525959] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.526183] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.526305] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.526815] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.526815] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.526966] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.527088] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.527292] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.527430] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.527637] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.527745] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 699.527848] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 699.527947] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 699.528062] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 699.528162] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 699.528286] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 699.548106] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 699.548280] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 699.548413] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 699.548582] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.548891] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-712c488a-b4d8-4512-9449-47ab345bca3a taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.549079] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-712c488a-b4d8-4512-9449-47ab345bca3a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.549196] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-712c488a-b4d8-4512-9449-47ab345bca3a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.549517] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-712c488a-b4d8-4512-9449-47ab345bca3a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.549649] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('712c488a-b4d8-4512-9449-47ab345bca3a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.776999] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-11ffe783-216b-4365-8e11-ae5102ef6592 service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 699.777373] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-11ffe783-216b-4365-8e11-ae5102ef6592 service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 699.777373] env[65106]: INFO networking_nsxv3.common.synchronization [req-47f3ef94-32cd-4c0a-ba0e-680a0ffcd6aa req-11ffe783-216b-4365-8e11-ae5102ef6592 service nova] Enqueued Resource ID: bdab7fab-97ae-46cd-8c05-3478cd419693 with Priority: HIGHEST for action port [ 699.777921] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 699.777921] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 699.778141] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdab7fab-97ae-46cd-8c05-3478cd419693 with Priority: HIGHEST for action port [ 699.778273] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.778386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.778564] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.779310] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.779448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.779564] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdab7fab-97ae-46cd-8c05-3478cd419693 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.779667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdab7fab-97ae-46cd-8c05-3478cd419693" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.779915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdab7fab-97ae-46cd-8c05-3478cd419693" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.779915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdab7fab-97ae-46cd-8c05-3478cd419693" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.780317] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdab7fab-97ae-46cd-8c05-3478cd419693',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.052224] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.052488] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.052733] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.052924] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.053089] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.053265] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 712c488a-b4d8-4512-9449-47ab345bca3a not found, creating... [ 700.053525] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.053834] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.053834] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.054022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.054118] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.054371] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.054541] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.054741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.054842] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.054955] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.055134] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 712c488a-b4d8-4512-9449-47ab345bca3a is going to be created. [ 700.075487] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.075720] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.075833] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.077251] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.077251] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.077251] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-712c488a-b4d8-4512-9449-47ab345bca3a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.284712] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.284712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.284712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.284712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.284712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.284712] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 700.284712] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdab7fab-97ae-46cd-8c05-3478cd419693 with status ACTIVE [ 700.284712] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.284712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.284712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.286716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.286992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.287285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.287780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.287955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.288225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.288537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.290805] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.290805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.290805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.290805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.290805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.290805] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdab7fab-97ae-46cd-8c05-3478cd419693 is going to be updated. [ 700.323165] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.323165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.323165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.324106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.324106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.324106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdab7fab-97ae-46cd-8c05-3478cd419693" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.329554] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.329554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.329554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.331656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.331656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.342642] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 700.928785] env[65106]: INFO networking_nsxv3.common.synchronization [req-65c1325e-c7d0-4543-8cdb-8e6bf5d4722f req-31a2c683-c520-4e00-be4b-f356ae20f0e4 tempest-SecurityGroupRulesTestJSON-2091241041 tempest-SecurityGroupRulesTestJSON-2091241041-project-member] Enqueued Resource ID: 984cbd29-ad79-43bc-bc36-53b142329e1f with Priority: HIGHEST for action security_group_rules [ 700.929932] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 984cbd29-ad79-43bc-bc36-53b142329e1f with Priority: HIGHEST for action security_group_rules [ 700.929932] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-984cbd29-ad79-43bc-bc36-53b142329e1f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.929932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.929932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.931267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.931267] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('984cbd29-ad79-43bc-bc36-53b142329e1f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.951845] env[65106]: INFO networking_nsxv3.common.synchronization [req-46a4916a-efa4-442a-8e1a-84321de838e0 req-546c5221-8e6b-4617-8118-f3b0ba8c0b97 service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 700.951845] env[65106]: INFO networking_nsxv3.common.synchronization [req-46a4916a-efa4-442a-8e1a-84321de838e0 req-546c5221-8e6b-4617-8118-f3b0ba8c0b97 service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 700.951973] env[65106]: INFO networking_nsxv3.common.synchronization [req-46a4916a-efa4-442a-8e1a-84321de838e0 req-546c5221-8e6b-4617-8118-f3b0ba8c0b97 service nova] Enqueued Resource ID: 712c488a-b4d8-4512-9449-47ab345bca3a with Priority: HIGHEST for action port [ 700.953280] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 700.953349] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 700.953967] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 712c488a-b4d8-4512-9449-47ab345bca3a with Priority: HIGHEST for action port [ 700.953967] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.953967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.953967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.955103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.955103] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.956213] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.956213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.956336] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-712c488a-b4d8-4512-9449-47ab345bca3a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.956473] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-712c488a-b4d8-4512-9449-47ab345bca3a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.956473] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-712c488a-b4d8-4512-9449-47ab345bca3a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.956623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-712c488a-b4d8-4512-9449-47ab345bca3a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.956677] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('712c488a-b4d8-4512-9449-47ab345bca3a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.408079] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 701.408277] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 deletion is rescheduled due to dependency. [ 701.408430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.408595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.408827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.409019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.409165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.409214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.409535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.409535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.409535] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.461042] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.464251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.464251] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 712c488a-b4d8-4512-9449-47ab345bca3a with status ACTIVE [ 701.464251] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.464251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.464251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.464251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.464251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.464251] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.464251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.464251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.464820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.464820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.464820] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.464933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.464964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.465297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.465383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.465455] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 712c488a-b4d8-4512-9449-47ab345bca3a is going to be updated. [ 701.499485] env[65106]: INFO networking_nsxv3.common.synchronization [req-5a359bf0-4c8e-4ed2-88ee-70f3f578fb5f req-076d4cd2-c8fe-423f-bd72-b7b375be4772 tempest-ServerDiagnosticsTest-1538870275 tempest-ServerDiagnosticsTest-1538870275-project-member] Enqueued Resource ID: 8062a050-fddc-4392-b032-558be3ae0629 with Priority: HIGHEST for action security_group_members [ 701.500970] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062a050-fddc-4392-b032-558be3ae0629 with Priority: HIGHEST for action security_group_members [ 701.501845] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062a050-fddc-4392-b032-558be3ae0629 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.501962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.503115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.503115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.503115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.503115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.503115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.503115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.503346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.503346] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062a050-fddc-4392-b032-558be3ae0629',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.537460] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.537661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.537661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.538027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.538125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.538223] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 984cbd29-ad79-43bc-bc36-53b142329e1f already deleted. [ 701.538310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.549057] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.549057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.549057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.550466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.550466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.550466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-712c488a-b4d8-4512-9449-47ab345bca3a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.912181] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.935508] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.935864] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.935916] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.936196] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.936504] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.936681] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.936796] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.937017] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.937757] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.937973] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.938457] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.938649] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.938823] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.939037] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.939225] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.939411] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.962096] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.962439] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.962850] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.962850] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.963431] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-521adf23-95ca-45fe-be14-51925ffd29e1 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.963431] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-521adf23-95ca-45fe-be14-51925ffd29e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.963431] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-521adf23-95ca-45fe-be14-51925ffd29e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.964051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-521adf23-95ca-45fe-be14-51925ffd29e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.964051] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('521adf23-95ca-45fe-be14-51925ffd29e1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.005386] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.005577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.005675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.005919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.006574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.006574] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.006574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.006574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.006574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.006784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.006784] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062a050-fddc-4392-b032-558be3ae0629 already deleted. [ 702.006784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.303528] env[65106]: INFO networking_nsxv3.common.synchronization [req-499710f0-665a-4dda-97bf-a2bd23e05cd7 req-3702e53f-01c8-4f1e-a459-a158ed524908 tempest-SecurityGroupRulesTestJSON-2091241041 tempest-SecurityGroupRulesTestJSON-2091241041-project-member] Enqueued Resource ID: 984cbd29-ad79-43bc-bc36-53b142329e1f with Priority: HIGHEST for action security_group_rules [ 702.305038] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 984cbd29-ad79-43bc-bc36-53b142329e1f with Priority: HIGHEST for action security_group_rules [ 702.305038] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-984cbd29-ad79-43bc-bc36-53b142329e1f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.305408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.305408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.306088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.306088] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('984cbd29-ad79-43bc-bc36-53b142329e1f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.366965] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 702.367679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.367923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.368315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.368436] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.368583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.368679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.368911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.369461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.369461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.369461] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.369461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.370080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.370080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.370150] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.370317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.370419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.370629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.370751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.370867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.371015] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.372361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.372361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.373554] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.373554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.373554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.373554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.373554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.373554] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.415083] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.470024] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.470219] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.471656] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.471656] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.471656] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.471656] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 521adf23-95ca-45fe-be14-51925ffd29e1 not found, creating... [ 702.471656] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.471656] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.471993] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.472052] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.473486] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.473486] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.473486] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.473486] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.474032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.474150] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.474738] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 521adf23-95ca-45fe-be14-51925ffd29e1 is going to be created. [ 702.498481] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.498679] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.498808] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.499093] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.499319] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.499537] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-521adf23-95ca-45fe-be14-51925ffd29e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.835980] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.836185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.836653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.836653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.836653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.836653] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 984cbd29-ad79-43bc-bc36-53b142329e1f already deleted. [ 702.837371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.877221] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52a63c62-ab68-4afc-b239-81d4bb46173e: rpc.has_security_group_logging(os_id): False [ 702.878731] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.900783] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.901009] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.901172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.901469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.901606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.901917] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.902067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.902144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.902367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.902465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.902755] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.902906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.903700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.903700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.903700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.903700] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.903700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.903700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.904626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.904626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.904626] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be created. [ 702.917241] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.917494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.917494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.917700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.917793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.917896] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 702.960141] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.960713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.960713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.960938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.961425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.975490] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 703.000081] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.000344] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.000448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.000835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.001261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.017830] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 703.335839] env[65106]: INFO networking_nsxv3.common.synchronization [req-5a359bf0-4c8e-4ed2-88ee-70f3f578fb5f req-e70af39f-8e8e-4e9c-b59d-056cc2acccce service nova] Enqueued Resource ID: 8062a050-fddc-4392-b032-558be3ae0629 with Priority: HIGHEST for action security_group_rules [ 703.335839] env[65106]: INFO networking_nsxv3.common.synchronization [req-5a359bf0-4c8e-4ed2-88ee-70f3f578fb5f req-e70af39f-8e8e-4e9c-b59d-056cc2acccce service nova] Enqueued Resource ID: 8062a050-fddc-4392-b032-558be3ae0629 with Priority: HIGHEST for action security_group_members [ 703.335839] env[65106]: INFO networking_nsxv3.common.synchronization [req-5a359bf0-4c8e-4ed2-88ee-70f3f578fb5f req-e70af39f-8e8e-4e9c-b59d-056cc2acccce service nova] Enqueued Resource ID: 521adf23-95ca-45fe-be14-51925ffd29e1 with Priority: HIGHEST for action port [ 703.338226] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062a050-fddc-4392-b032-558be3ae0629 with Priority: HIGHEST for action security_group_rules [ 703.338226] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062a050-fddc-4392-b032-558be3ae0629 with Priority: HIGHEST for action security_group_members [ 703.338226] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 521adf23-95ca-45fe-be14-51925ffd29e1 with Priority: HIGHEST for action port [ 703.338226] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8062a050-fddc-4392-b032-558be3ae0629 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.338226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.338226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.340653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.340653] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8062a050-fddc-4392-b032-558be3ae0629',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.343736] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062a050-fddc-4392-b032-558be3ae0629 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.343825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.343878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.344069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.344259] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.349209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.349209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.349209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.349209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.349209] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062a050-fddc-4392-b032-558be3ae0629',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.350311] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-521adf23-95ca-45fe-be14-51925ffd29e1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.350526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-521adf23-95ca-45fe-be14-51925ffd29e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.350584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-521adf23-95ca-45fe-be14-51925ffd29e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.350786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-521adf23-95ca-45fe-be14-51925ffd29e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.350984] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('521adf23-95ca-45fe-be14-51925ffd29e1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.381502] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.857248] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8062a050-fddc-4392-b032-558be3ae0629',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.857918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062a050-fddc-4392-b032-558be3ae0629 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.858312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.858393] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 521adf23-95ca-45fe-be14-51925ffd29e1 with status ACTIVE [ 703.858722] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.859414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.859414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.859414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.859663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.859779] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.859967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.860105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.861252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.861252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.861252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.861252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.861252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.861597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.861597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.861597] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 521adf23-95ca-45fe-be14-51925ffd29e1 is going to be updated. [ 703.885953] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.886110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.886110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.886388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.886518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.886621] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 703.889586] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.889586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.889586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.889845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.890019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.890442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-521adf23-95ca-45fe-be14-51925ffd29e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.922142] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.922142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.922142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.922441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.922610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.934412] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 703.985847] env[65106]: INFO networking_nsxv3.common.synchronization [req-a7d4c879-1f19-4d30-9e89-81b0dea7cc50 req-b2ed3b7f-f971-4124-a13d-70343bfd7dab tempest-SecurityGroupRulesTestJSON-2091241041 tempest-SecurityGroupRulesTestJSON-2091241041-project-member] Enqueued Resource ID: 984cbd29-ad79-43bc-bc36-53b142329e1f with Priority: HIGHEST for action security_group_rules [ 703.986457] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 984cbd29-ad79-43bc-bc36-53b142329e1f with Priority: HIGHEST for action security_group_rules [ 703.986631] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-984cbd29-ad79-43bc-bc36-53b142329e1f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.986748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.986829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.987023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.987130] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('984cbd29-ad79-43bc-bc36-53b142329e1f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.368509] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8062a050-fddc-4392-b032-558be3ae0629',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.508760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.508933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.509030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.509274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.509376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.509482] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 984cbd29-ad79-43bc-bc36-53b142329e1f already deleted. [ 704.509566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-984cbd29-ad79-43bc-bc36-53b142329e1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.872372] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.872372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.872372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.872372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.872372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.872372] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062a050-fddc-4392-b032-558be3ae0629 is going to be created. [ 704.898028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.898213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.898248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.898481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.898757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.910578] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062a050-fddc-4392-b032-558be3ae0629 in Status: UNINITIALIZED for 2s [ 704.988800] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 704.988800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.988800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.988800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.988800] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.988800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.988800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.988800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.988800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.988800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.988800] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.032393] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 705.032680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.032958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.033267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.033364] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.091561] env[65106]: INFO networking_nsxv3.common.synchronization [None req-deacff14-8cdd-406c-b0b3-2d1d3306c669 tempest-MigrationsAdminTest-232602271 tempest-MigrationsAdminTest-232602271-project-member] Enqueued Resource ID: 43abc5d9-26f2-48d5-9659-8a037a254a2b with Priority: HIGHEST for action security_group_rules [ 705.092506] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43abc5d9-26f2-48d5-9659-8a037a254a2b with Priority: HIGHEST for action security_group_rules [ 705.093137] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43abc5d9-26f2-48d5-9659-8a037a254a2b taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.093339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43abc5d9-26f2-48d5-9659-8a037a254a2b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.093689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43abc5d9-26f2-48d5-9659-8a037a254a2b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.093909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43abc5d9-26f2-48d5-9659-8a037a254a2b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.094074] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43abc5d9-26f2-48d5-9659-8a037a254a2b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.221098] env[65106]: INFO networking_nsxv3.common.synchronization [None req-da812a8c-a677-4bf4-8bc8-2b86525ad3af tempest-MigrationsAdminTest-232602271 tempest-MigrationsAdminTest-232602271-project-member] Enqueued Resource ID: 43abc5d9-26f2-48d5-9659-8a037a254a2b with Priority: HIGHEST for action security_group_rules [ 705.222120] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43abc5d9-26f2-48d5-9659-8a037a254a2b with Priority: HIGHEST for action security_group_rules [ 705.222359] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43abc5d9-26f2-48d5-9659-8a037a254a2b taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.222455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43abc5d9-26f2-48d5-9659-8a037a254a2b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.491943] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.492329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.492388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.492673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.492911] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.493047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.493119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.493380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.493569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.493615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.493787] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.493928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.493973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.494247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.494364] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.494507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.494544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.494734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.494846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.494971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.495799] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.536544] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.536998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.619899] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.620578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.620578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.620578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.620578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.620740] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43abc5d9-26f2-48d5-9659-8a037a254a2b already deleted. [ 705.620768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43abc5d9-26f2-48d5-9659-8a037a254a2b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.620931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43abc5d9-26f2-48d5-9659-8a037a254a2b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.621150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43abc5d9-26f2-48d5-9659-8a037a254a2b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.621322] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43abc5d9-26f2-48d5-9659-8a037a254a2b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.949452] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 705.949887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.950123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.950371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.950619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.950760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.950824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.951398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.951398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.951398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.951398] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.000832] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4b9f28-129e-4614-b2d6-9173d8122416: rpc.has_security_group_logging(os_id): False [ 706.032529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.032529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.032529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.032529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.032529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.032529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.032529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.032529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.032529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.032529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.033076] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.033323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.033465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.033702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.033862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.034396] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.035464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.035464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.035464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.035464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.035464] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 706.148064] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.148320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.148523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.148667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.148792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.148933] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43abc5d9-26f2-48d5-9659-8a037a254a2b already deleted. [ 706.149139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43abc5d9-26f2-48d5-9659-8a037a254a2b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.165251] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.165541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.165629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.165980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.166435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.189779] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 706.455939] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.456161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.456231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.456459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.456639] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.456747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.456807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.456963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.457272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.457272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.457446] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.457581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.457651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.457811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.457959] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.458044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.458268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.458268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.458397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.458397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.458485] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.921206] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062a050-fddc-4392-b032-558be3ae0629 in Status: SUCCESS [ 706.921509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.921721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.921943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.922155] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.922408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.922482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.922644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.922725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.922809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.922914] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8062a050-fddc-4392-b032-558be3ae0629',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.961511] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52a63c62-ab68-4afc-b239-81d4bb46173e: rpc.has_security_group_logging(os_id): False [ 706.968328] env[65106]: INFO networking_nsxv3.common.synchronization [req-f2505e2c-e7b5-4415-9c76-53adab773e6c req-4fb682bd-9c7a-4b6f-90a8-c684e084c124 tempest-VolumesAdminNegativeTest-2004313853 tempest-VolumesAdminNegativeTest-2004313853-project-member] Enqueued Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGHEST for action security_group_members [ 706.968854] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGHEST for action security_group_members [ 706.969203] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-81a7c51f-690b-43e1-a214-2196c4632ae4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.969333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.969402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.969602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.969750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.970165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.970165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.970242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.970411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.970523] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.982168] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.982342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.982419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.982670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.982758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.982993] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.983320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.983320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.983430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.983501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.983706] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.983867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.983867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.984075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.984208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.984368] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.984472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.984515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.984706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.984792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.984989] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 707.062203] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.062507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.062507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.062718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.062896] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.076096] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 707.425953] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062a050-fddc-4392-b032-558be3ae0629 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.426189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.426189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.426719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.426719] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.426719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.426892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.426919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.427022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.427201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.427283] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062a050-fddc-4392-b032-558be3ae0629 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.427360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.427413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.427789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.427789] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.427789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.427789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.428562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.428562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.428562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.428562] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8062a050-fddc-4392-b032-558be3ae0629',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.472550] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.472709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.472785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.472984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.473091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.473360] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.473468] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.473531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.473727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.473807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.473896] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 is going to be updated. [ 707.514453] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.514453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.514453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.514453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.514947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.530170] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 in Status: IN_PROGRESS for 2s [ 707.930282] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8062a050-fddc-4392-b032-558be3ae0629: rpc.has_security_group_logging(os_id): False [ 707.952914] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.953150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.953150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.953454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.953573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.953770] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.953899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.954233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.954233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.954233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.954413] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.954509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.954578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.954724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.954798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.955024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.955110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.955166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.955322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.955398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.955490] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8062a050-fddc-4392-b032-558be3ae0629 is going to be created. [ 708.019081] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.019081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.019081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.019081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.019081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.030119] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062a050-fddc-4392-b032-558be3ae0629 in Status: IN_PROGRESS for 2s [ 708.208731] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 708.209196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.022850] env[65106]: INFO networking_nsxv3.common.synchronization [req-33c1c23c-cd62-430a-88ff-e5f3666c841f req-75e40176-4a2a-4b02-8575-9ca048fb39b4 tempest-ServersAdminTestJSON-1615839610 tempest-ServersAdminTestJSON-1615839610-project-member] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 709.023836] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 709.024270] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.024442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.024560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.024856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.025017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.025172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.025288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.025540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.025698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.025916] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.092459] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 709.092672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.093233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.093499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.093707] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.325789] env[65106]: INFO networking_nsxv3.common.synchronization [None req-42718793-2298-48b6-9e30-a2c4e836da4a None None] Enqueued Resource ID: cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6 with Priority: HIGHEST for action port [ 709.326320] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6 with Priority: HIGHEST for action port [ 709.326670] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.326833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.326906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.327632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.327728] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.427392] env[65106]: INFO networking_nsxv3.common.synchronization [None req-e8f17981-542e-425b-8104-eb12a12679ab None None] Enqueued Resource ID: 23a8606e-955e-4cc8-9ab1-1518d8082db0 with Priority: HIGHEST for action port [ 709.427681] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23a8606e-955e-4cc8-9ab1-1518d8082db0 with Priority: HIGHEST for action port [ 709.428298] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-23a8606e-955e-4cc8-9ab1-1518d8082db0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.428424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23a8606e-955e-4cc8-9ab1-1518d8082db0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.428492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23a8606e-955e-4cc8-9ab1-1518d8082db0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.428749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23a8606e-955e-4cc8-9ab1-1518d8082db0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.428829] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23a8606e-955e-4cc8-9ab1-1518d8082db0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.529601] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.540221] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 in Status: SUCCESS [ 709.540445] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 deletion is rescheduled due to dependency. [ 709.540566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.595997] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.596223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.596268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.596537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.596723] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.596831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.596897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.597073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.597157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.597245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.597334] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.830152] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6 [ 709.830576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.830576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.830576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.830684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.830792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.830834] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6 already deleted. [ 709.830910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbfe9cd6-b691-477c-a35d-f2bc42d5ffe6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.937295] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23a8606e-955e-4cc8-9ab1-1518d8082db0 [ 709.937295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.937295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.937295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.937295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.937295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.937295] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23a8606e-955e-4cc8-9ab1-1518d8082db0 already deleted. [ 709.937295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23a8606e-955e-4cc8-9ab1-1518d8082db0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.037412] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.048729] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8062a050-fddc-4392-b032-558be3ae0629 in Status: SUCCESS [ 710.049782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.102062] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.102251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.102320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.103053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.103053] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.103053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.103053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.103053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.103254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.103254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.103436] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.103535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.103590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.103727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.104355] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.104355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.104355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.104355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.104355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.104355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.104610] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.131070] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-118 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.132553] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.132553] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.132553] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.132553] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.133034] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.133173] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.133469] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.133624] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.133822] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.133939] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 710.134051] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 710.134149] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 710.134783] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 710.134783] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 710.134783] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 710.156328] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 710.157549] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 710.157835] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 710.158783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-118" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.158783] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-272e3929-5070-4365-8dc1-0ac4cf843af3 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.158783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-272e3929-5070-4365-8dc1-0ac4cf843af3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.158783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-272e3929-5070-4365-8dc1-0ac4cf843af3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.159145] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-272e3929-5070-4365-8dc1-0ac4cf843af3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.159145] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('272e3929-5070-4365-8dc1-0ac4cf843af3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.540496] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.540496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.541052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.541052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.541052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.541052] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 710.571083] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.571083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.571083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.571454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.571760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.583822] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 710.608268] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52a63c62-ab68-4afc-b239-81d4bb46173e: rpc.has_security_group_logging(os_id): False [ 710.629894] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.629894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.629894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.629894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.629894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.629894] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.629894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.629894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.629894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.629894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.630443] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.630443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.630443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.630443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.630443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.630599] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.630690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.630747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.630884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.630958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.631074] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 710.664120] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.664120] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.664120] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.664120] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.664120] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.664120] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 272e3929-5070-4365-8dc1-0ac4cf843af3 not found, creating... [ 710.665921] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.665921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.665921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.665921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.665921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.665921] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.665921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.665921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.665921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.665921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.666461] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 272e3929-5070-4365-8dc1-0ac4cf843af3 is going to be created. [ 710.692181] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.692326] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.692433] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.692765] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.694177] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.694456] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-272e3929-5070-4365-8dc1-0ac4cf843af3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.718104] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.718104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.718357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.718511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.718654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.754053] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 710.888571] env[65106]: INFO networking_nsxv3.common.synchronization [req-1eecea46-e775-41f6-8c76-9daebc14ba4d req-732cd116-89b2-4398-bf44-0120a2dabd33 tempest-ServersAdminNegativeTestJSON-1593145529 tempest-ServersAdminNegativeTestJSON-1593145529-project-member] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 710.888739] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 710.889044] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.889174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.889231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.889675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.889844] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.889966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.890028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.890180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.890298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.890365] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.392835] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.456529] env[65106]: INFO networking_nsxv3.common.synchronization [req-33c1c23c-cd62-430a-88ff-e5f3666c841f req-b3e2bdbb-8a25-4fb8-9dd4-60f28cbab4e5 service nova] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_rules [ 711.457232] env[65106]: INFO networking_nsxv3.common.synchronization [req-33c1c23c-cd62-430a-88ff-e5f3666c841f req-b3e2bdbb-8a25-4fb8-9dd4-60f28cbab4e5 service nova] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 711.458055] env[65106]: INFO networking_nsxv3.common.synchronization [req-33c1c23c-cd62-430a-88ff-e5f3666c841f req-b3e2bdbb-8a25-4fb8-9dd4-60f28cbab4e5 service nova] Enqueued Resource ID: 272e3929-5070-4365-8dc1-0ac4cf843af3 with Priority: HIGHEST for action port [ 711.458652] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_rules [ 711.458652] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 711.458652] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 272e3929-5070-4365-8dc1-0ac4cf843af3 with Priority: HIGHEST for action port [ 711.459299] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.459299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.459299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.459898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.459898] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.462217] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.462217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.462217] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-272e3929-5070-4365-8dc1-0ac4cf843af3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.462217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-272e3929-5070-4365-8dc1-0ac4cf843af3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.462462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-272e3929-5070-4365-8dc1-0ac4cf843af3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.463033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-272e3929-5070-4365-8dc1-0ac4cf843af3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.463033] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('272e3929-5070-4365-8dc1-0ac4cf843af3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.571949] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.572311] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.572311] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.572594] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.572868] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.573122] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.573285] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.573538] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.573754] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.574808] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.574808] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 711.574808] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 711.574808] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 711.574808] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 711.574808] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 711.574808] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 711.586474] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d09d9674-13ac-4517-baa5-a9bb3c6edf3f None None] Enqueued Resource ID: e9e472ce-141e-4f4c-b7e0-3bc90d166bbf with Priority: HIGHEST for action port [ 711.587167] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9e472ce-141e-4f4c-b7e0-3bc90d166bbf with Priority: HIGHEST for action port [ 711.587332] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9e472ce-141e-4f4c-b7e0-3bc90d166bbf taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.587456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9e472ce-141e-4f4c-b7e0-3bc90d166bbf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.587522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9e472ce-141e-4f4c-b7e0-3bc90d166bbf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.587773] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9e472ce-141e-4f4c-b7e0-3bc90d166bbf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.588295] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9e472ce-141e-4f4c-b7e0-3bc90d166bbf',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.594653] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 711.594969] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 711.595157] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 711.595490] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.595735] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-5c480f6b-a139-4d58-b40e-ac59873c1b83 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.595940] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-5c480f6b-a139-4d58-b40e-ac59873c1b83" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.596128] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-5c480f6b-a139-4d58-b40e-ac59873c1b83" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.599986] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-5c480f6b-a139-4d58-b40e-ac59873c1b83" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.599986] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c480f6b-a139-4d58-b40e-ac59873c1b83',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.896159] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.965300] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.965300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.970115] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 272e3929-5070-4365-8dc1-0ac4cf843af3 with status ACTIVE [ 711.970115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.970115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.970115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.970846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.970913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.972558] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.972558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.972558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.972558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.972558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.972558] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.972558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.972558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.972558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.972558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.972558] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 272e3929-5070-4365-8dc1-0ac4cf843af3 is going to be updated. [ 712.001523] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.001634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.001634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.001839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.002027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.002164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-272e3929-5070-4365-8dc1-0ac4cf843af3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.092923] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e9e472ce-141e-4f4c-b7e0-3bc90d166bbf [ 712.092923] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.092923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.092923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.092923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.092923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.092923] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e9e472ce-141e-4f4c-b7e0-3bc90d166bbf already deleted. [ 712.092923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9e472ce-141e-4f4c-b7e0-3bc90d166bbf" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.101379] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.102205] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.102205] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.102205] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.102482] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.102482] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 5c480f6b-a139-4d58-b40e-ac59873c1b83 not found, creating... [ 712.103102] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.103102] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.103102] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.103518] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.103855] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.103964] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.104097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.104201] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.104860] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.104860] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.104860] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 5c480f6b-a139-4d58-b40e-ac59873c1b83 is going to be created. [ 712.127750] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.130718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.130718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.130718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.130718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.130718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-5c480f6b-a139-4d58-b40e-ac59873c1b83" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.399498] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.399498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.399498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.399498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.399498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.399498] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5872a413-0244-4425-a9f8-dd282f886327 is going to be updated. [ 712.462424] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.462749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.462892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.463434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.463595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.474201] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: IN_PROGRESS for 2s [ 712.595930] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 712.596219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.596356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.596564] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.596751] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.596864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.596981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.597122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.597212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.597310] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.768523] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 712.768710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.809331] env[65106]: INFO networking_nsxv3.common.synchronization [None req-88f19bb5-1877-4a9f-99b4-d568450fea69 None None] Enqueued Resource ID: 1f0ad0e4-6c01-4a6d-9174-74250a9d8d76 with Priority: HIGHEST for action port [ 712.809834] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f0ad0e4-6c01-4a6d-9174-74250a9d8d76 with Priority: HIGHEST for action port [ 712.810155] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f0ad0e4-6c01-4a6d-9174-74250a9d8d76 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.810320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f0ad0e4-6c01-4a6d-9174-74250a9d8d76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.810590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f0ad0e4-6c01-4a6d-9174-74250a9d8d76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.810673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f0ad0e4-6c01-4a6d-9174-74250a9d8d76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.810729] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f0ad0e4-6c01-4a6d-9174-74250a9d8d76',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.882976] env[65106]: INFO networking_nsxv3.common.synchronization [req-1eecea46-e775-41f6-8c76-9daebc14ba4d req-5bdef5ae-ce44-4b90-ad13-8a5260118f31 service nova] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_rules [ 712.883191] env[65106]: INFO networking_nsxv3.common.synchronization [req-1eecea46-e775-41f6-8c76-9daebc14ba4d req-5bdef5ae-ce44-4b90-ad13-8a5260118f31 service nova] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 712.883341] env[65106]: INFO networking_nsxv3.common.synchronization [req-1eecea46-e775-41f6-8c76-9daebc14ba4d req-5bdef5ae-ce44-4b90-ad13-8a5260118f31 service nova] Enqueued Resource ID: 5c480f6b-a139-4d58-b40e-ac59873c1b83 with Priority: HIGHEST for action port [ 712.883845] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_rules [ 712.883979] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 712.884134] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c480f6b-a139-4d58-b40e-ac59873c1b83 with Priority: HIGHEST for action port [ 712.884353] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.884516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.884545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.884759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.884834] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.885631] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.885722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.885979] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c480f6b-a139-4d58-b40e-ac59873c1b83 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.886144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c480f6b-a139-4d58-b40e-ac59873c1b83" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.886217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c480f6b-a139-4d58-b40e-ac59873c1b83" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.886392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c480f6b-a139-4d58-b40e-ac59873c1b83" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.886467] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c480f6b-a139-4d58-b40e-ac59873c1b83',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.100345] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.283347] env[65106]: INFO networking_nsxv3.common.synchronization [None req-9809749b-c078-43e4-a2e3-17e28cf087cc tempest-ServersTestFqdnHostnames-225825114 tempest-ServersTestFqdnHostnames-225825114-project-member] Enqueued Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_rules [ 713.283918] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_rules [ 713.288760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.288935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.289017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.289287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.289403] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.314577] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1f0ad0e4-6c01-4a6d-9174-74250a9d8d76 [ 713.314577] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.314577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.314577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.314799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.314799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.314862] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1f0ad0e4-6c01-4a6d-9174-74250a9d8d76 already deleted. [ 713.315719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f0ad0e4-6c01-4a6d-9174-74250a9d8d76" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.388597] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.392025] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c480f6b-a139-4d58-b40e-ac59873c1b83 with status ACTIVE [ 713.392025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.392025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.392025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.392025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.393017] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c480f6b-a139-4d58-b40e-ac59873c1b83 is going to be updated. [ 713.417120] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.417279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.419046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.419046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.419046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.419046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c480f6b-a139-4d58-b40e-ac59873c1b83" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.564603] env[65106]: INFO networking_nsxv3.common.synchronization [None req-182d7d9a-a3e4-4169-a1f3-565c990b2167 tempest-ServersTestFqdnHostnames-225825114 tempest-ServersTestFqdnHostnames-225825114-project-member] Enqueued Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_rules [ 713.564603] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_rules [ 713.564603] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.564603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.605855] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.724773] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3c5d8f5-cd01-41e5-9980-463f78aec577 req-ed566733-50ff-46c8-a60c-1cbc36451412 tempest-MultipleCreateTestJSON-2038244732 tempest-MultipleCreateTestJSON-2038244732-project-member] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 713.725348] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 713.725642] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.725755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.725868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.726019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.731037] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.731379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.731379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.731479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.731520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.731615] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.810845] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.811129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.811129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.811283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.813686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.813686] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 already deleted. [ 713.813686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.813686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.813686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.813686] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.108034] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.108321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.108495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.108768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.108849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.108964] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 714.147926] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.148097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.148171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.148405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.148551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.161262] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 714.234221] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.234571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.234700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.235030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.235434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.235588] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.237037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.237037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.237037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.237037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.237037] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 714.271324] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.271555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.271555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.271712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.271870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.287226] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 714.335249] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.335249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.335249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.335463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.335565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.335675] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 already deleted. [ 714.335762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.484539] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: SUCCESS [ 714.484770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.485318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.485318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.485512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.485512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.485637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.485770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.485854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.485950] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.830755] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.831169] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.831169] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.831870] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.832368] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.832654] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.832783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.833198] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.833263] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.833547] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.833666] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 714.833772] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 714.833876] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 714.833991] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 714.834110] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 714.834436] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 714.856253] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 714.856615] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 714.856615] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 714.856784] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.857123] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-ee64f071-d302-45b6-9f2c-3e32a6b1f579 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.857296] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-ee64f071-d302-45b6-9f2c-3e32a6b1f579" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.857417] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-ee64f071-d302-45b6-9f2c-3e32a6b1f579" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.857739] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-ee64f071-d302-45b6-9f2c-3e32a6b1f579" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.857876] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee64f071-d302-45b6-9f2c-3e32a6b1f579',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.988659] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.091361] env[65106]: INFO networking_nsxv3.common.synchronization [None req-85e138f0-9373-402f-87f3-8137de8b1b3a None None] Enqueued Resource ID: 5bd4e66b-0920-44e7-b7bb-c7586015f955 with Priority: HIGHEST for action port [ 715.091898] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bd4e66b-0920-44e7-b7bb-c7586015f955 with Priority: HIGHEST for action port [ 715.092214] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bd4e66b-0920-44e7-b7bb-c7586015f955 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.092371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bd4e66b-0920-44e7-b7bb-c7586015f955" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.092449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bd4e66b-0920-44e7-b7bb-c7586015f955" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.092692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bd4e66b-0920-44e7-b7bb-c7586015f955" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.092775] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bd4e66b-0920-44e7-b7bb-c7586015f955',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.362395] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.362630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.362761] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.363087] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.363236] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.363424] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port ee64f071-d302-45b6-9f2c-3e32a6b1f579 not found, creating... [ 715.363722] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.363874] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.363983] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.364217] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.364351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.364663] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.364826] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.364985] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.365281] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.365421] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.365557] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: ee64f071-d302-45b6-9f2c-3e32a6b1f579 is going to be created. [ 715.387507] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.387697] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.387814] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.388103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.388365] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.388614] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-ee64f071-d302-45b6-9f2c-3e32a6b1f579" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.491467] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.595122] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bd4e66b-0920-44e7-b7bb-c7586015f955 [ 715.595327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.595469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.595534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.595757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.595846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.595940] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bd4e66b-0920-44e7-b7bb-c7586015f955 already deleted. [ 715.596030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bd4e66b-0920-44e7-b7bb-c7586015f955" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.994619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.994619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.994619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.995068] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.995068] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.995068] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5872a413-0244-4425-a9f8-dd282f886327 is going to be updated. [ 716.029464] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.029661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.029700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.029902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.030082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.053224] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: IN_PROGRESS for 2s [ 716.111519] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3c5d8f5-cd01-41e5-9980-463f78aec577 req-91ebd145-2cf4-4fb8-a3f0-987c9c11ef8b service nova] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_rules [ 716.111766] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3c5d8f5-cd01-41e5-9980-463f78aec577 req-91ebd145-2cf4-4fb8-a3f0-987c9c11ef8b service nova] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 716.112176] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3c5d8f5-cd01-41e5-9980-463f78aec577 req-91ebd145-2cf4-4fb8-a3f0-987c9c11ef8b service nova] Enqueued Resource ID: ee64f071-d302-45b6-9f2c-3e32a6b1f579 with Priority: HIGHEST for action port [ 716.112696] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_rules [ 716.112914] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 716.113073] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee64f071-d302-45b6-9f2c-3e32a6b1f579 with Priority: HIGHEST for action port [ 716.113450] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.114126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.114126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.114126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.114126] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.115034] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.115034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.115306] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee64f071-d302-45b6-9f2c-3e32a6b1f579 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.115444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee64f071-d302-45b6-9f2c-3e32a6b1f579" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.115526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee64f071-d302-45b6-9f2c-3e32a6b1f579" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.115720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee64f071-d302-45b6-9f2c-3e32a6b1f579" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.115820] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee64f071-d302-45b6-9f2c-3e32a6b1f579',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.172150] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 716.172411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.172587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.172794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.172983] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.173126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.173191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.173379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.173499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.173601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.173699] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.302000] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 716.302207] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 deletion is rescheduled due to dependency. [ 716.302430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.302626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.302852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.303062] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.304349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.306008] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.306008] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.306008] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.306008] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.553076] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3c5d8f5-cd01-41e5-9980-463f78aec577 req-8f50bde3-c9a9-4300-a175-65faa1989a25 tempest-MultipleCreateTestJSON-2038244732 tempest-MultipleCreateTestJSON-2038244732-project-member] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 716.555550] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 716.557185] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.557519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.618264] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.618264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.620711] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee64f071-d302-45b6-9f2c-3e32a6b1f579 with status ACTIVE [ 716.621252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.621581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.624814] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.624814] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.624814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.624814] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee64f071-d302-45b6-9f2c-3e32a6b1f579 is going to be updated. [ 716.655936] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.655936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.655936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.655936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.655936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.655936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee64f071-d302-45b6-9f2c-3e32a6b1f579" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.678985] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.678985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.679189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.679264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.679426] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.679529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.679593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.679741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.679828] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.679914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.680076] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.680171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.680232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.680401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.680543] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.680636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.680696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.680833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.680911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.680994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.681098] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.810373] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.972841] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-815 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.973866] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.974276] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.977031] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.977031] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.977031] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.977031] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.977031] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.977031] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.977031] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.977031] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.977031] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.977031] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.977031] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.977031] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.977031] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 717.000662] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 717.000962] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 717.001122] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 717.001354] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-815" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.001634] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.001805] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.001927] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.002252] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.002537] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.144434] env[65106]: INFO networking_nsxv3.common.synchronization [None req-da24d606-bfe1-4cca-82e8-437d6a978188 None None] Enqueued Resource ID: 37fdc475-2c1d-4c1d-b68b-e6afd7847b00 with Priority: HIGHEST for action port [ 717.145086] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37fdc475-2c1d-4c1d-b68b-e6afd7847b00 with Priority: HIGHEST for action port [ 717.145421] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-37fdc475-2c1d-4c1d-b68b-e6afd7847b00 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.145547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37fdc475-2c1d-4c1d-b68b-e6afd7847b00" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.145628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37fdc475-2c1d-4c1d-b68b-e6afd7847b00" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.146062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37fdc475-2c1d-4c1d-b68b-e6afd7847b00" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.146260] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37fdc475-2c1d-4c1d-b68b-e6afd7847b00',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.184368] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f58b21a0-a1cb-4daa-9136-8c66dc9641d3: rpc.has_security_group_logging(os_id): False [ 717.206374] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.206606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.206606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.206828] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.206949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.207208] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.207314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.207379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.207873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.207873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.207960] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.208022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.208052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.208189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.208268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.208498] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.208598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.208663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.208826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.208902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.208987] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 717.287734] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.287898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.287971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.288231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.288380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.313845] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.338557] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 717.505225] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.505477] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.505634] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.505987] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.506065] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.506888] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9 not found, creating... [ 717.506888] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.506888] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.506888] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.507177] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.507177] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.507476] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.507618] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.507729] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.507933] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.508074] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.508207] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9 is going to be created. [ 717.534111] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.534111] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.535525] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.535790] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.536135] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.536461] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.650116] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37fdc475-2c1d-4c1d-b68b-e6afd7847b00 [ 717.650378] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.650526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.650609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.651146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.651146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.651146] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37fdc475-2c1d-4c1d-b68b-e6afd7847b00 already deleted. [ 717.651146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37fdc475-2c1d-4c1d-b68b-e6afd7847b00" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.820026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.820026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.820026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.820026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.820026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.820026] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 717.851374] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.851542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.851586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.851797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.851996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.864048] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 718.066198] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: SUCCESS [ 718.066454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.066985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.066985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.067114] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.067234] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.067344] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.067573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.067632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.067740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.067849] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.307658] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3c5d8f5-cd01-41e5-9980-463f78aec577 req-ec718335-7e9c-42e4-be0c-aae569a90ea9 service nova] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_rules [ 718.307658] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3c5d8f5-cd01-41e5-9980-463f78aec577 req-ec718335-7e9c-42e4-be0c-aae569a90ea9 service nova] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 718.307658] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3c5d8f5-cd01-41e5-9980-463f78aec577 req-ec718335-7e9c-42e4-be0c-aae569a90ea9 service nova] Enqueued Resource ID: 60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9 with Priority: HIGHEST for action port [ 718.310562] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_rules [ 718.311980] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 718.311980] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9 with Priority: HIGHEST for action port [ 718.311980] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.312386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.312823] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.313061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.314157] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.314157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.314157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.314494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.314641] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.571186] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.571353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.571426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.571656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.571832] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.571935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.572008] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.572192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.572243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.572380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.572529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.572750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.572750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.572838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.572951] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.573764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.573764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.573764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.573764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.573764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.573764] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.578463] env[65106]: INFO networking_nsxv3.common.synchronization [None req-5fb0cb85-808c-4803-8b67-41fa800eed13 None None] Enqueued Resource ID: 3234a29d-3cff-4876-a986-7edd92fd610a with Priority: HIGHEST for action port [ 718.580826] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3234a29d-3cff-4876-a986-7edd92fd610a with Priority: HIGHEST for action port [ 718.581200] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-3234a29d-3cff-4876-a986-7edd92fd610a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.581352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3234a29d-3cff-4876-a986-7edd92fd610a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.581729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3234a29d-3cff-4876-a986-7edd92fd610a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.584095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3234a29d-3cff-4876-a986-7edd92fd610a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.584268] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3234a29d-3cff-4876-a986-7edd92fd610a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.817442] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9 with status ACTIVE [ 718.817834] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.817976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.820825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.820825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.820825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.820825] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.820825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.820825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.820825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.820825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.821164] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.821259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.821286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.821497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.821611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.821741] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9 is going to be updated. [ 718.849676] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.849835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.849921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.851276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.852053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.852053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60311fdc-5fc6-4cb8-aeed-d05e3b44fbb9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.080524] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5872a413-0244-4425-a9f8-dd282f886327: rpc.has_security_group_logging(os_id): False [ 719.094455] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3234a29d-3cff-4876-a986-7edd92fd610a [ 719.095049] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.095049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.095049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.095291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.095379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.095427] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3234a29d-3cff-4876-a986-7edd92fd610a already deleted. [ 719.095514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3234a29d-3cff-4876-a986-7edd92fd610a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.104636] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.104907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.104907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.105104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.105211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.105543] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.105810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.105810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.106082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.106082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.106245] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.106372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.106372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.106538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.106620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.106828] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.106975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.109047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.109047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.109233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.109788] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5872a413-0244-4425-a9f8-dd282f886327 is going to be updated. [ 719.179948] env[65106]: INFO networking_nsxv3.common.synchronization [req-d0fb6f19-f667-4d03-87be-e02e6ef13e4f req-b95c1b03-0c65-44e4-b5da-e545bad0ba0c tempest-AttachVolumeShelveTestJSON-512943003 tempest-AttachVolumeShelveTestJSON-512943003-project-member] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_members [ 719.179948] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.179948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.179948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.179948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.179948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.181966] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_members [ 719.182482] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.182638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.182740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.183548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.185176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.185176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.185176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.185176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.185176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.185176] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.200060] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: IN_PROGRESS for 2s [ 719.357285] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 719.357504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.679961] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.680200] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.680367] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.680750] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.681016] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.684529] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.684688] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.684985] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.685153] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.685362] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.685470] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.685584] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.685666] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.685765] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.685864] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.685987] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.693769] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.693953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.694014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.697055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.697055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.697055] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.697055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.697055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.697055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.697055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.697055] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 already deleted. [ 719.697055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.712172] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.715184] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 719.715184] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.715184] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.715417] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.715615] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.715780] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.716210] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.716381] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.875544] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 719.875789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.876293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.876417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.876949] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.877373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.877373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.877508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.877614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.877751] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.221195] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.221766] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.221887] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.222718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.222718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.222718] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 not found, creating... [ 720.222968] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.223189] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.223326] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.223577] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.223773] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.224088] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.224476] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.224476] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.224563] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.224803] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.224952] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 is going to be created. [ 720.246613] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.246830] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.246940] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.247480] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.247763] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.248049] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.380497] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.532302] env[65106]: INFO networking_nsxv3.common.synchronization [None req-bda71c6e-5839-43e3-8eab-8e68682067af None None] Enqueued Resource ID: 81d74072-0738-4349-a51e-80bbdfe6a4b6 with Priority: HIGHEST for action port [ 720.532972] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81d74072-0738-4349-a51e-80bbdfe6a4b6 with Priority: HIGHEST for action port [ 720.533313] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-81d74072-0738-4349-a51e-80bbdfe6a4b6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.533469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81d74072-0738-4349-a51e-80bbdfe6a4b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.533536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81d74072-0738-4349-a51e-80bbdfe6a4b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.533806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81d74072-0738-4349-a51e-80bbdfe6a4b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.533890] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81d74072-0738-4349-a51e-80bbdfe6a4b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.882484] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.989655] env[65106]: INFO networking_nsxv3.common.synchronization [req-d0fb6f19-f667-4d03-87be-e02e6ef13e4f req-c4875feb-6bd1-428d-a0fc-8e615307697e service nova] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_rules [ 720.989826] env[65106]: INFO networking_nsxv3.common.synchronization [req-d0fb6f19-f667-4d03-87be-e02e6ef13e4f req-c4875feb-6bd1-428d-a0fc-8e615307697e service nova] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_members [ 720.989958] env[65106]: INFO networking_nsxv3.common.synchronization [req-d0fb6f19-f667-4d03-87be-e02e6ef13e4f req-c4875feb-6bd1-428d-a0fc-8e615307697e service nova] Enqueued Resource ID: fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 with Priority: HIGHEST for action port [ 720.992185] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_rules [ 720.992185] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_members [ 720.992185] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 with Priority: HIGHEST for action port [ 720.992185] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.992185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.992185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.992600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.993664] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.996452] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.996452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.996452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.996452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.996452] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.996452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.996452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.996452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.996452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.996886] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.997696] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.997696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.997813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.997886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.000023] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.036013] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81d74072-0738-4349-a51e-80bbdfe6a4b6 [ 721.036246] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.036486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.036565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.036813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.036941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.037696] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81d74072-0738-4349-a51e-80bbdfe6a4b6 already deleted. [ 721.037696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81d74072-0738-4349-a51e-80bbdfe6a4b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.215099] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: SUCCESS [ 721.215414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.318013] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b9a5acbd-3aa4-4f6b-8890-e386984f9d82 None None] Enqueued Resource ID: 66600b28-850e-44dc-bc25-1407d97c13ca with Priority: HIGHEST for action port [ 721.318293] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66600b28-850e-44dc-bc25-1407d97c13ca with Priority: HIGHEST for action port [ 721.319631] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-66600b28-850e-44dc-bc25-1407d97c13ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.319631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66600b28-850e-44dc-bc25-1407d97c13ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.321169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66600b28-850e-44dc-bc25-1407d97c13ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.321453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66600b28-850e-44dc-bc25-1407d97c13ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.321548] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66600b28-850e-44dc-bc25-1407d97c13ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.385822] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.386380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.386873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.387210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.387276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.387386] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 721.425190] env[65106]: INFO networking_nsxv3.common.synchronization [req-53b5b585-8651-4f10-b1ee-335eea26d845 req-fd298e75-89ec-4e1f-9854-f412d218d8b2 tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 721.425190] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.425190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.425190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.425754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.426109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.429821] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 721.430572] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.431346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.431588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.431930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.433092] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.433092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.433092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.433092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.433092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.433092] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.448933] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 721.502417] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.502902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.502902] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.503730] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 with status ACTIVE [ 721.503933] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.504074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.504128] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.504375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.504555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.504650] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.504750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.504812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.504964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.505735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.505991] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.508196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.508196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.508196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.508196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.508196] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 is going to be updated. [ 721.538912] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.540084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.540084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.541357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.541357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.541357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.813196] env[65106]: INFO networking_nsxv3.common.synchronization [req-53b5b585-8651-4f10-b1ee-335eea26d845 req-82f72f87-355f-4b74-8b88-551846a79302 tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 721.813196] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 721.813890] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.813890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.825041] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66600b28-850e-44dc-bc25-1407d97c13ca [ 721.825292] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.825425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.825494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.825738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.825830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.825988] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66600b28-850e-44dc-bc25-1407d97c13ca already deleted. [ 721.826091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66600b28-850e-44dc-bc25-1407d97c13ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.937415] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.011410] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.240719] env[65106]: INFO networking_nsxv3.common.synchronization [req-53b5b585-8651-4f10-b1ee-335eea26d845 req-1bb02383-92ff-4e87-b374-a99ff5b39dd9 tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 722.241285] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 722.241582] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.241680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.440088] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.515199] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.515363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.515438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.516201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.516201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.516201] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 is going to be created. [ 722.542947] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.543173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.543220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.543489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.544108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.555608] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: UNINITIALIZED for 2s [ 722.943317] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.943823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.943823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.943823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.944170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.944170] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 722.977920] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.978109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.978163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.978339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.978484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.991358] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 723.466453] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 723.466453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.466453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.466453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.466453] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.466453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.466453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.466453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.466453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.466453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.466453] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.467136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.467359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.467552] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.467660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.467721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.467866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.467941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.468047] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.863226] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0f39309d-fa9b-4b29-91e9-841a8179cdd7 None None] Enqueued Resource ID: cf847711-7129-4855-90d7-bb7a25d426ea with Priority: HIGHEST for action port [ 723.863930] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf847711-7129-4855-90d7-bb7a25d426ea with Priority: HIGHEST for action port [ 723.864449] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf847711-7129-4855-90d7-bb7a25d426ea taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.864582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf847711-7129-4855-90d7-bb7a25d426ea" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.864666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf847711-7129-4855-90d7-bb7a25d426ea" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.864965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf847711-7129-4855-90d7-bb7a25d426ea" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.865066] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf847711-7129-4855-90d7-bb7a25d426ea',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.969599] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.971195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.971195] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.028895] env[65106]: INFO networking_nsxv3.common.synchronization [None req-1eba3001-414c-4cc1-8031-5370d5f03d25 tempest-ImagesOneServerNegativeTestJSON-531782934 tempest-ImagesOneServerNegativeTestJSON-531782934-project-member] Enqueued Resource ID: 73a9495f-5c30-4f67-9374-6420673a85cb with Priority: HIGHEST for action security_group_rules [ 724.029556] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a9495f-5c30-4f67-9374-6420673a85cb with Priority: HIGHEST for action security_group_rules [ 724.032783] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73a9495f-5c30-4f67-9374-6420673a85cb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.032962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73a9495f-5c30-4f67-9374-6420673a85cb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.033030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73a9495f-5c30-4f67-9374-6420673a85cb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.033355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73a9495f-5c30-4f67-9374-6420673a85cb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.033498] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73a9495f-5c30-4f67-9374-6420673a85cb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.246133] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ceedd4e3-4d3c-4260-99d4-fd4f0d2860fb tempest-ImagesOneServerNegativeTestJSON-531782934 tempest-ImagesOneServerNegativeTestJSON-531782934-project-member] Enqueued Resource ID: 73a9495f-5c30-4f67-9374-6420673a85cb with Priority: HIGHEST for action security_group_rules [ 724.246820] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73a9495f-5c30-4f67-9374-6420673a85cb with Priority: HIGHEST for action security_group_rules [ 724.247166] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-73a9495f-5c30-4f67-9374-6420673a85cb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.247265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-73a9495f-5c30-4f67-9374-6420673a85cb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.368312] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf847711-7129-4855-90d7-bb7a25d426ea [ 724.368312] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.368312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.368312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.368312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.368610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.368610] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf847711-7129-4855-90d7-bb7a25d426ea already deleted. [ 724.368610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf847711-7129-4855-90d7-bb7a25d426ea" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.472115] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.567417] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.567417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.567665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.567833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.568787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.568787] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73a9495f-5c30-4f67-9374-6420673a85cb already deleted. [ 724.568787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73a9495f-5c30-4f67-9374-6420673a85cb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.568787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-73a9495f-5c30-4f67-9374-6420673a85cb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.568787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-73a9495f-5c30-4f67-9374-6420673a85cb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.568787] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('73a9495f-5c30-4f67-9374-6420673a85cb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.572826] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: SUCCESS [ 724.572826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.572826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.574093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.574093] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.574093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.574093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.574306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.574420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.574833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.574959] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.974623] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.974813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.974873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.975231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.975424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.975626] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 725.001666] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 725.001666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.001666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.001666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.002164] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.002164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.002164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.002164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.002295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.002330] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.009362] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.009362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.009362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.009362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.009362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.021149] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 725.077640] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.099254] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.099254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.099254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.099254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.099254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.099254] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 73a9495f-5c30-4f67-9374-6420673a85cb already deleted. [ 725.099254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-73a9495f-5c30-4f67-9374-6420673a85cb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.506383] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.506710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.506710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.506859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.506959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.508494] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.508658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.508725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.508906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.508990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.509125] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 725.539820] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.539996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.540118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.540487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.540623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.554882] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 725.584542] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898: rpc.has_security_group_logging(os_id): False [ 725.608750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.608750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.608750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.608750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.608750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.608750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.608750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.608750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.608750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.608750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.608750] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 is going to be created. [ 725.691013] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.691013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.691013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.691013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.691013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.708188] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: IN_PROGRESS for 2s [ 727.034506] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 727.035312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.035312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.035312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.035497] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.035687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.035762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.035995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.036061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.036144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.036320] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.036422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.036484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.036745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.036912] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.037064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.037138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.037340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.037389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.037459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.037618] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.540149] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 032e481c-c000-4759-9f25-bd2a5ca64cb7: rpc.has_security_group_logging(os_id): False [ 727.575240] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.575416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.575519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.575749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.575840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.577084] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.577084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.577084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.577084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.577084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.577084] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.577084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.577084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.577084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.577084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.577440] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.577525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.577586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.577724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.577808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.577892] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 727.579753] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 727.579901] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e deletion is rescheduled due to dependency. [ 727.580023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.580198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.580410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.580629] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.580746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.580816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.581017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.581106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.581218] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.662753] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.663653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.663856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.664595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.666902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.699101] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 727.737895] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: SUCCESS [ 727.739663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.923269] env[65106]: INFO networking_nsxv3.common.synchronization [req-266b2e77-1399-474d-9bf8-4ebde097f6b3 req-ee6de942-de04-4482-ac23-cbd11a63f219 tempest-ServerDiagnosticsTest-1538870275 tempest-ServerDiagnosticsTest-1538870275-project-member] Enqueued Resource ID: 8062a050-fddc-4392-b032-558be3ae0629 with Priority: HIGHEST for action security_group_members [ 727.923969] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8062a050-fddc-4392-b032-558be3ae0629 with Priority: HIGHEST for action security_group_members [ 727.925050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-8062a050-fddc-4392-b032-558be3ae0629 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.925177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.925276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.925619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.926095] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.926095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.926264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.926513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.926658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.927303] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8062a050-fddc-4392-b032-558be3ae0629',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.084535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.084815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.084815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.085023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.085152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.085394] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.085526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.085600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.085773] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.085850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.085940] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 728.114699] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.114948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.114948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.115182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.115306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.125204] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 728.433162] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.433162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.433162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.433162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.433162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.433345] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.433426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.433489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.433810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.433902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.434016] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062a050-fddc-4392-b032-558be3ae0629 is going to be updated. [ 728.475738] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.475738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.475922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.476031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.476159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.486506] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062a050-fddc-4392-b032-558be3ae0629 in Status: IN_PROGRESS for 2s [ 728.570603] env[65106]: INFO networking_nsxv3.common.synchronization [None req-633c4ab6-7ff0-4d4a-818e-b25d8e26abe9 None None] Enqueued Resource ID: 02f10d40-6a7f-40c1-8997-ee2084cad2a2 with Priority: HIGHEST for action port [ 728.571103] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02f10d40-6a7f-40c1-8997-ee2084cad2a2 with Priority: HIGHEST for action port [ 728.571400] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-02f10d40-6a7f-40c1-8997-ee2084cad2a2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.571515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02f10d40-6a7f-40c1-8997-ee2084cad2a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.571772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02f10d40-6a7f-40c1-8997-ee2084cad2a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.571866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02f10d40-6a7f-40c1-8997-ee2084cad2a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.572020] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02f10d40-6a7f-40c1-8997-ee2084cad2a2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.076715] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02f10d40-6a7f-40c1-8997-ee2084cad2a2 [ 729.076869] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.077634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.078769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.079063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.079678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.079678] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02f10d40-6a7f-40c1-8997-ee2084cad2a2 already deleted. [ 729.079678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02f10d40-6a7f-40c1-8997-ee2084cad2a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.720545] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 729.720912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.721000] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.721222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.721311] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.145617] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 730.145897] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e deletion is rescheduled due to dependency. [ 730.145968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.224402] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.224402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.224402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.224402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.224931] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.224931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.224931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.224931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.224931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.225130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.225130] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.498146] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8062a050-fddc-4392-b032-558be3ae0629 in Status: SUCCESS [ 730.498335] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8062a050-fddc-4392-b032-558be3ae0629 deletion is rescheduled due to dependency. [ 730.498449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8062a050-fddc-4392-b032-558be3ae0629" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.662284] env[65106]: INFO networking_nsxv3.common.synchronization [req-51e90992-dc90-4ce7-8d9f-de14df17e345 req-91055401-94ee-47b9-83a1-8fed370d1a01 tempest-ServersWithSpecificFlavorTestJSON-165470677 tempest-ServersWithSpecificFlavorTestJSON-165470677-project-member] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 730.662899] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 730.665327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.665578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.666180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.666479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.666672] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.666796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.666896] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.667161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.667326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.667448] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.727822] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.728242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.728242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.728242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.728528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.728528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.729959] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.729959] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.729959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.730517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.730517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.730517] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.171517] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.173945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.173945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.173945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.173945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.173945] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.173945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.173945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.173945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.173945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.173945] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 is going to be updated. [ 731.234296] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 032e481c-c000-4759-9f25-bd2a5ca64cb7: rpc.has_security_group_logging(os_id): False [ 731.261603] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.261603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.261603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.261603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.261603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.268889] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.268889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.269221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.270319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.270319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.270319] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.270711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.270711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.270813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.270930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.271263] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.271474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.271590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.271821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.271970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.272267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.272523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.272523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.272827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.272827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.273910] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 731.277102] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: IN_PROGRESS for 2s [ 731.436637] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.437301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.437301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.437647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.437918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.475655] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d3e9f31d-9e77-4007-b5e9-52001469ce11 None None] Enqueued Resource ID: 02bfc6a8-98cc-4bd1-a60f-8731bf7b8469 with Priority: HIGHEST for action port [ 731.476645] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02bfc6a8-98cc-4bd1-a60f-8731bf7b8469 with Priority: HIGHEST for action port [ 731.477139] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-02bfc6a8-98cc-4bd1-a60f-8731bf7b8469 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.477139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02bfc6a8-98cc-4bd1-a60f-8731bf7b8469" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.477139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02bfc6a8-98cc-4bd1-a60f-8731bf7b8469" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.477390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02bfc6a8-98cc-4bd1-a60f-8731bf7b8469" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.477503] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02bfc6a8-98cc-4bd1-a60f-8731bf7b8469',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.493716] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 731.509248] env[65106]: INFO networking_nsxv3.common.synchronization [req-55bd4151-6ce4-492b-979b-08cd0422e1c8 req-7f4b10c7-9b9f-4aa3-9457-0c54bedc6a33 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 731.511694] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 731.511759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.511838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.511904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.516080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.516080] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.516080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.516080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.516080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.516080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.516080] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.929301] env[65106]: INFO networking_nsxv3.common.synchronization [req-c39bf182-b6d3-411f-afe5-3f2796b8e21b req-563f7edf-4691-4e15-a201-621c5062c2ae tempest-ServersTestJSON-1102962073 tempest-ServersTestJSON-1102962073-project-member] Enqueued Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_members [ 731.930051] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dcae410-a891-453e-bd43-6b1770f373d3 with Priority: HIGHEST for action security_group_members [ 731.930647] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dcae410-a891-453e-bd43-6b1770f373d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.930782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.930831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.931142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.931377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.931436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.931504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.932065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.932194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.932327] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dcae410-a891-453e-bd43-6b1770f373d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.980592] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02bfc6a8-98cc-4bd1-a60f-8731bf7b8469 [ 731.981536] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.981536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.981704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.981891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.982481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.982481] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02bfc6a8-98cc-4bd1-a60f-8731bf7b8469 already deleted. [ 731.982481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02bfc6a8-98cc-4bd1-a60f-8731bf7b8469" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.016431] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.016604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.017065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.017065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.017065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.017287] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.017365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.017365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.017520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.017599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.017681] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d already deleted. [ 732.017760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.041587] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-162 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.042308] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-162" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.042434] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-162" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.042964] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-162" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.043285] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.043454] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.043566] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.043804] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.043948] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.044173] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.044284] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.044388] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.044491] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.044594] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.044695] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.044822] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.084969] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.085062] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.040 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.085199] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.085483] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-162" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.085904] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-7237cabd-cc25-410b-a518-5f70a471b2de taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.086091] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.086204] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.086506] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.086948] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7237cabd-cc25-410b-a518-5f70a471b2de',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.435028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.435327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.435440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.435766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.435926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.436252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.436476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.436571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.436806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.436936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.437093] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcae410-a891-453e-bd43-6b1770f373d3 is going to be updated. [ 732.487689] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.488086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.488086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.488817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.488817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.531517] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcae410-a891-453e-bd43-6b1770f373d3 in Status: IN_PROGRESS for 2s [ 732.594448] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.598024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.598024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.598024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.598024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.598024] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 7237cabd-cc25-410b-a518-5f70a471b2de not found, creating... [ 732.598024] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.598024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.599179] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.599573] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.599914] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.600365] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.600673] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.600939] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.601273] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.601496] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.603027] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 7237cabd-cc25-410b-a518-5f70a471b2de is going to be created. [ 732.629199] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.629443] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.629559] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.630254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.630254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.630455] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.287865] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: SUCCESS [ 733.289669] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 deletion is rescheduled due to dependency. [ 733.289669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.388594] env[65106]: INFO networking_nsxv3.common.synchronization [req-55bd4151-6ce4-492b-979b-08cd0422e1c8 req-bc063f62-c364-419b-9663-02f0b3321a78 service nova] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 733.388789] env[65106]: INFO networking_nsxv3.common.synchronization [req-55bd4151-6ce4-492b-979b-08cd0422e1c8 req-bc063f62-c364-419b-9663-02f0b3321a78 service nova] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 733.389008] env[65106]: INFO networking_nsxv3.common.synchronization [req-55bd4151-6ce4-492b-979b-08cd0422e1c8 req-bc063f62-c364-419b-9663-02f0b3321a78 service nova] Enqueued Resource ID: 7237cabd-cc25-410b-a518-5f70a471b2de with Priority: HIGHEST for action port [ 733.390639] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 733.390639] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 733.390639] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7237cabd-cc25-410b-a518-5f70a471b2de with Priority: HIGHEST for action port [ 733.390639] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.390639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.390639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.390916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.391024] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.392116] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.392252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.392320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.392526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.392807] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.392922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.392985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.393155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.393242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.393599] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.394711] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7237cabd-cc25-410b-a518-5f70a471b2de taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.394711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.394871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.394948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.394980] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7237cabd-cc25-410b-a518-5f70a471b2de',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.434958] env[65106]: INFO networking_nsxv3.common.synchronization [req-47fdc39d-e2bb-44e4-9356-08c1c057c8f9 req-fd955ee1-090e-4325-91c7-1e4704af2cc8 tempest-ServersTestBootFromVolume-1396593016 tempest-ServersTestBootFromVolume-1396593016-project-member] Enqueued Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_members [ 733.435544] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGHEST for action security_group_members [ 733.435856] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6947545-c4e6-4692-9dfa-c1bdd403650c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.435967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.436048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.436574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.436574] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.436574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.436574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.436788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.436788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.436851] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.511918] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 733.512646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.897673] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.897673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.897673] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.898496] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7237cabd-cc25-410b-a518-5f70a471b2de with status ACTIVE [ 733.898677] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.898784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.898846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.899067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.899157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.899423] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.899423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.899498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.899606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.899709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.899879] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.899933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.899990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.902923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.902923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.902923] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7237cabd-cc25-410b-a518-5f70a471b2de is going to be updated. [ 733.929595] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.929767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.929767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.930031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.930120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.930560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.938957] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.939193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.940494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.940494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.940494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.940494] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.940494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.940494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.940494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.940494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.940494] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6947545-c4e6-4692-9dfa-c1bdd403650c is going to be updated. [ 733.969391] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.970305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.970305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.970305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.970305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.981300] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6947545-c4e6-4692-9dfa-c1bdd403650c in Status: IN_PROGRESS for 2s [ 734.403507] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.542413] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dcae410-a891-453e-bd43-6b1770f373d3 in Status: SUCCESS [ 734.542413] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dcae410-a891-453e-bd43-6b1770f373d3 deletion is rescheduled due to dependency. [ 734.542639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dcae410-a891-453e-bd43-6b1770f373d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.907116] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.907362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.907578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.907830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.908643] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.908643] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d is going to be created. [ 734.936835] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.937024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.937110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.937279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.937442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.950358] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: UNINITIALIZED for 2s [ 735.994505] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6947545-c4e6-4692-9dfa-c1bdd403650c in Status: SUCCESS [ 735.994863] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6947545-c4e6-4692-9dfa-c1bdd403650c deletion is rescheduled due to dependency. [ 735.995029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.593601] env[65106]: INFO networking_nsxv3.common.synchronization [req-3b461f60-aa37-4e1a-a761-572d793fe398 req-dc4148be-4cb6-4da4-a413-7d140e37ecf9 tempest-MultipleCreateTestJSON-2038244732 tempest-MultipleCreateTestJSON-2038244732-project-member] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 736.594483] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 736.594647] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.594786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.594867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.595077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.595270] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.595403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.595448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.595635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.595725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.595843] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.963401] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: SUCCESS [ 736.963609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.963838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.964314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.964540] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.964751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.964883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.965254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.965352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.965549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.965628] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.993503] env[65106]: INFO networking_nsxv3.common.synchronization [req-7bc34e72-bbcb-4f99-8f66-5b0a81e9e944 req-88db5df6-7b63-44c8-98fe-8c6f8e32e3a0 tempest-MultipleCreateTestJSON-2038244732 tempest-MultipleCreateTestJSON-2038244732-project-member] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 736.994381] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGHEST for action security_group_members [ 736.994983] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.995316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.098405] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.468612] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.601076] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.971746] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19332543-7a24-4c8f-8b80-055c71f06f3d: rpc.has_security_group_logging(os_id): False [ 737.997763] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.998175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.998175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.998430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.998644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.998912] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.999076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.999169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.999491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.999645] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.999764] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d is going to be created. [ 738.068232] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.068502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.068502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.068717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.068941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.084551] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: IN_PROGRESS for 2s [ 738.103351] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.103676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.103676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.103934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.104110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.104240] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 738.151223] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.151456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.151456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.151685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.151845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.176255] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 740.097324] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: SUCCESS [ 740.097617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.190528] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 740.190772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.191185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.191267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.191432] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.191551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.191607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.191756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.191837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.191935] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.694524] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.694717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.694821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.695200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.695346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.695592] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.695728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.695832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.696039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.696164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.696292] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be updated. [ 740.729176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.729385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.729385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.729616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.729760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.745733] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: IN_PROGRESS for 2s [ 741.995394] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 741.995768] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 742.759715] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 in Status: SUCCESS [ 742.759913] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 deletion is rescheduled due to dependency. [ 742.760045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.111748] env[65106]: INFO networking_nsxv3.common.synchronization [None req-85daf2c1-ee66-4737-b487-bef05c5cccf8 None None] Enqueued Resource ID: a667e5ee-da78-4119-9ad0-abd08d6b830c with Priority: HIGHEST for action port [ 743.111748] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a667e5ee-da78-4119-9ad0-abd08d6b830c with Priority: HIGHEST for action port [ 743.111748] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a667e5ee-da78-4119-9ad0-abd08d6b830c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.111748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a667e5ee-da78-4119-9ad0-abd08d6b830c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.111748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a667e5ee-da78-4119-9ad0-abd08d6b830c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.112503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a667e5ee-da78-4119-9ad0-abd08d6b830c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.112609] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a667e5ee-da78-4119-9ad0-abd08d6b830c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.615185] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a667e5ee-da78-4119-9ad0-abd08d6b830c [ 743.616479] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.616479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.616479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.616479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.616479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.616479] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a667e5ee-da78-4119-9ad0-abd08d6b830c already deleted. [ 743.616479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a667e5ee-da78-4119-9ad0-abd08d6b830c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.048991] env[65106]: INFO networking_nsxv3.common.synchronization [None req-f45ce5f9-aa54-4a3d-8cc9-4f803d7f8e52 tempest-AttachVolumeTestJSON-98661006 tempest-AttachVolumeTestJSON-98661006-project-member] Enqueued Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_rules [ 744.050186] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_rules [ 744.050186] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.050186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.050186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.050641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.050641] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.156517] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d89b5844-4dd1-4127-a08a-a61e0dc2bbc2 tempest-AttachVolumeTestJSON-98661006 tempest-AttachVolumeTestJSON-98661006-project-member] Enqueued Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_rules [ 744.156517] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_rules [ 744.156517] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.156517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.573188] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.573338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.573391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.573603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.573695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.573801] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 already deleted. [ 744.573884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.575266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.575408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.575529] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.101411] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.101411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.101411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.101411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.101411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.101625] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 already deleted. [ 745.101625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.665931] env[65106]: INFO networking_nsxv3.common.synchronization [req-6ba16279-8839-454f-bd31-de5ad74d504c req-0ce1730f-3686-45f4-a132-c1a50cee0daf tempest-ServerMetadataTestJSON-565346210 tempest-ServerMetadataTestJSON-565346210-project-member] Enqueued Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGHEST for action security_group_members [ 745.666479] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGHEST for action security_group_members [ 745.666890] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.666890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.667017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.667216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.667377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.667476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.667535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.667689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.667771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.667877] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.683648] env[65106]: INFO networking_nsxv3.common.synchronization [req-57be38dd-ba75-4a39-a01d-258f744972ae req-9a28e2d2-d468-487a-a000-7fd7bb416271 tempest-ServersAdminNegativeTestJSON-1593145529 tempest-ServersAdminNegativeTestJSON-1593145529-project-member] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 745.684852] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 745.686156] env[65106]: INFO networking_nsxv3.common.synchronization [None req-5a974cb8-15ef-4960-b4dd-8bc34bfe2adf None None] Enqueued Resource ID: f5c9c2bc-2d1b-43ac-8045-98886b47bc54 with Priority: HIGHEST for action port [ 745.686333] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.686454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.686523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.686715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.686868] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.686960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.687030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.687424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.687424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.687424] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.689985] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5c9c2bc-2d1b-43ac-8045-98886b47bc54 with Priority: HIGHEST for action port [ 745.691327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5c9c2bc-2d1b-43ac-8045-98886b47bc54 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.691436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5c9c2bc-2d1b-43ac-8045-98886b47bc54" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.691496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5c9c2bc-2d1b-43ac-8045-98886b47bc54" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.691712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5c9c2bc-2d1b-43ac-8045-98886b47bc54" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.691797] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5c9c2bc-2d1b-43ac-8045-98886b47bc54',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.049151] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-272 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.049151] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-272" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.049151] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-272" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.049151] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-272" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.049151] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.049151] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.049151] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.049567] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.049614] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.049850] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.049982] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.050150] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.050300] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.050470] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.050637] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.050798] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.070017] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.070257] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.070350] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.070853] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-272" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.071027] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-35cf7d82-862c-4516-8280-8c5c235e9056 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.071202] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-35cf7d82-862c-4516-8280-8c5c235e9056" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.072051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-35cf7d82-862c-4516-8280-8c5c235e9056" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.072051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-35cf7d82-862c-4516-8280-8c5c235e9056" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.072051] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35cf7d82-862c-4516-8280-8c5c235e9056',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.162807] env[65106]: INFO networking_nsxv3.common.synchronization [req-afb5f94a-b472-4e53-bae8-b9ba07d20f25 req-aa7ac1af-9a52-420f-a6ea-ffa5942c2365 tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 746.163462] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 746.163951] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.164135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.164135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.164396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.164684] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.164684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.164803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.164961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.165124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.165268] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.170125] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.170286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.170349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.170692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.170793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.171050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.171167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.171232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.171469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.171544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.171740] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 already deleted. [ 746.171740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.190753] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.195880] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5c9c2bc-2d1b-43ac-8045-98886b47bc54 [ 746.196118] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.196237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.196305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.196305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.196305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.196305] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5c9c2bc-2d1b-43ac-8045-98886b47bc54 already deleted. [ 746.196912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5c9c2bc-2d1b-43ac-8045-98886b47bc54" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.575370] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.575629] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.575768] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.576103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.576260] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.576412] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 35cf7d82-862c-4516-8280-8c5c235e9056 not found, creating... [ 746.576682] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.576846] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.576987] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.577258] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.577391] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.577670] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.577820] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.577934] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.578146] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.578305] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.578510] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 35cf7d82-862c-4516-8280-8c5c235e9056 is going to be created. [ 746.601032] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.601203] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.601334] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.601598] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.601822] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.602054] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-35cf7d82-862c-4516-8280-8c5c235e9056" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.667269] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.667597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.667597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.667731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.667900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.668074] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.668264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.668360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.668517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.668590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.668862] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 746.693702] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.713867] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.714121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.714231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.714523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.714804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.726512] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 747.197466] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.197466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.197466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.197466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.197466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.197466] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5872a413-0244-4425-a9f8-dd282f886327 is going to be updated. [ 747.227743] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.227948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.227991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.231531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.231531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.242019] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: IN_PROGRESS for 2s [ 747.313303] env[65106]: INFO networking_nsxv3.common.synchronization [req-6ba16279-8839-454f-bd31-de5ad74d504c req-ae3e220d-91af-44d6-9cf4-5f075f83604b service nova] Enqueued Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGHEST for action security_group_rules [ 747.313475] env[65106]: INFO networking_nsxv3.common.synchronization [req-6ba16279-8839-454f-bd31-de5ad74d504c req-ae3e220d-91af-44d6-9cf4-5f075f83604b service nova] Enqueued Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGHEST for action security_group_members [ 747.313607] env[65106]: INFO networking_nsxv3.common.synchronization [req-6ba16279-8839-454f-bd31-de5ad74d504c req-ae3e220d-91af-44d6-9cf4-5f075f83604b service nova] Enqueued Resource ID: 35cf7d82-862c-4516-8280-8c5c235e9056 with Priority: HIGHEST for action port [ 747.314344] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGHEST for action security_group_rules [ 747.314527] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGHEST for action security_group_members [ 747.314752] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35cf7d82-862c-4516-8280-8c5c235e9056 with Priority: HIGHEST for action port [ 747.315165] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.315300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.315369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.315640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.315729] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.317118] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.317118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.317118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.317118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.317352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.317352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.317352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.317477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.317557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.317706] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.318529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-35cf7d82-862c-4516-8280-8c5c235e9056 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.318636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35cf7d82-862c-4516-8280-8c5c235e9056" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.318699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35cf7d82-862c-4516-8280-8c5c235e9056" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.318851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35cf7d82-862c-4516-8280-8c5c235e9056" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.319231] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35cf7d82-862c-4516-8280-8c5c235e9056',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.823107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.823410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.823410] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.824305] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35cf7d82-862c-4516-8280-8c5c235e9056 with status ACTIVE [ 747.826514] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.826514] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.826514] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.826514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.826514] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35cf7d82-862c-4516-8280-8c5c235e9056 is going to be updated. [ 747.851574] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.851717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.851782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.851987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.852134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.852293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35cf7d82-862c-4516-8280-8c5c235e9056" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.329507] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.736509] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 748.736673] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 deletion is rescheduled due to dependency. [ 748.736785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.836415] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.836864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.836864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.837460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.837460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.837460] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 is going to be created. [ 748.872159] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.872306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.872412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.872875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.873084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.887464] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 in Status: UNINITIALIZED for 2s [ 749.255595] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: SUCCESS [ 749.255595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.615847] env[65106]: INFO networking_nsxv3.common.synchronization [req-1246c9c4-485a-4342-8f93-4508d6c9e7e7 req-4395bdb6-9905-4274-8163-5c7b3b5a88a7 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 750.616442] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 750.617076] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.617076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.617076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.617404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.617539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.617631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.617701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.617868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.618123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.618123] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.934996] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 in Status: SUCCESS [ 750.935249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.935424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.935901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.935901] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.936118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.936118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.936218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.936333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.936410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.936477] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.980183] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.980183] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-657" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.980183] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-657" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.980183] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-657" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.980183] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.980738] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.981129] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.981624] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.981904] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.982325] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.982595] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.982964] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.985025] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.985025] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.985025] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.985025] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.007234] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.007234] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.007234] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.007234] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-657" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.007234] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-98b466ee-a460-4056-85d6-d93a61a587f2 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.007234] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.007234] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.007234] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.007234] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98b466ee-a460-4056-85d6-d93a61a587f2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.121033] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.439035] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.439184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.439184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.439377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.439548] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.439674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.439750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.439946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.440389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.440389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.440389] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.440389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.440678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.440678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.440829] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.440884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.440950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.441091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.441172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.441275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.441375] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.511377] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.511713] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.511799] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.512201] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.512350] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.512548] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 98b466ee-a460-4056-85d6-d93a61a587f2 not found, creating... [ 751.512938] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.513107] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.513250] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.513595] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.513675] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.514007] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.514252] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.514385] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.514600] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.514745] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.514968] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 98b466ee-a460-4056-85d6-d93a61a587f2 is going to be created. [ 751.542953] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.543259] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.543387] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.543694] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.543946] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.544184] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.622746] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.944444] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b77c3b5-bcbc-4373-ba6a-5877c470d364: rpc.has_security_group_logging(os_id): False [ 751.965704] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.965704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.965704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.965704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.965704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.966220] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.966220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.966220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.966220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.966220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.966402] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.966504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.966557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.966705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.966792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.967017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.967121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.967187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.967354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.967454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.967541] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 is going to be created. [ 752.036220] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.036401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.036557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.036835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.037610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.052753] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 in Status: IN_PROGRESS for 2s [ 752.129168] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.129168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.129168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.129168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.129168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.129168] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 752.168665] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.168911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.168962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.169173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.169323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.180953] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 752.392345] env[65106]: INFO networking_nsxv3.common.synchronization [req-1246c9c4-485a-4342-8f93-4508d6c9e7e7 req-5adf8a31-b8dc-4b37-abc7-bfc1d1ab645a service nova] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 752.392507] env[65106]: INFO networking_nsxv3.common.synchronization [req-1246c9c4-485a-4342-8f93-4508d6c9e7e7 req-5adf8a31-b8dc-4b37-abc7-bfc1d1ab645a service nova] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 752.394679] env[65106]: INFO networking_nsxv3.common.synchronization [req-1246c9c4-485a-4342-8f93-4508d6c9e7e7 req-5adf8a31-b8dc-4b37-abc7-bfc1d1ab645a service nova] Enqueued Resource ID: 98b466ee-a460-4056-85d6-d93a61a587f2 with Priority: HIGHEST for action port [ 752.395596] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 752.395911] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 752.396102] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98b466ee-a460-4056-85d6-d93a61a587f2 with Priority: HIGHEST for action port [ 752.396494] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.396698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.396774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.397031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.397223] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.398566] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.398692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.398965] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-98b466ee-a460-4056-85d6-d93a61a587f2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.399107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.399161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.399386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.399488] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98b466ee-a460-4056-85d6-d93a61a587f2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.903281] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.904039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.904039] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98b466ee-a460-4056-85d6-d93a61a587f2 with status ACTIVE [ 752.904039] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.904173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.904173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.904340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.904438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.904722] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.904895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.904984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.905160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.905243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.905464] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.905561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.905616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.905783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.906050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.906050] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98b466ee-a460-4056-85d6-d93a61a587f2 is going to be updated. [ 752.930456] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.930697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.930697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.930886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.931029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.931183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.510540] env[65106]: INFO networking_nsxv3.common.synchronization [req-f7005849-6f08-4bfa-876a-221252c0b966 req-6b93e28b-a233-462f-93c9-471aaf64794a tempest-ServerRescueTestJSON-731943944 tempest-ServerRescueTestJSON-731943944-project-member] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 753.511977] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 753.511977] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.511977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.511977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.512533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.512740] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.512867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.512937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.513143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.513226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.513329] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.905645] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.906726] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-981" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.906726] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-981" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.906726] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-981" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.907135] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.907498] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.912575] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.913641] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.913641] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.913641] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.913641] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.913877] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.914029] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.914134] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.914309] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.914680] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.938218] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.938218] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.938218] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.938218] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-981" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.938218] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-1a085216-4541-482c-ab20-05dd664ea3a4 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.938589] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-1a085216-4541-482c-ab20-05dd664ea3a4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.938589] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-1a085216-4541-482c-ab20-05dd664ea3a4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.938737] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-1a085216-4541-482c-ab20-05dd664ea3a4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.938875] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a085216-4541-482c-ab20-05dd664ea3a4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.020023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.020023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.020023] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 already deleted. [ 754.020023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.068746] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 in Status: SUCCESS [ 754.069304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.193565] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 754.193835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.194032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.194282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.194489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.194604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.194670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.195039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.195039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.195138] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.442516] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.442752] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.442926] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.443254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.443506] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.443575] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 1a085216-4541-482c-ab20-05dd664ea3a4 not found, creating... [ 754.443945] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.444123] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.444243] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.444534] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.444739] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.445078] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.445252] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.445423] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.445716] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.445850] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.445993] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 1a085216-4541-482c-ab20-05dd664ea3a4 is going to be created. [ 754.468050] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.468263] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.468405] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.468669] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.468987] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.469253] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-1a085216-4541-482c-ab20-05dd664ea3a4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.699044] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.203445] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.204999] env[65106]: INFO networking_nsxv3.common.synchronization [req-f7005849-6f08-4bfa-876a-221252c0b966 req-90e3b370-5383-4238-8fe8-a1cad0c6b7a9 service nova] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_rules [ 755.206627] env[65106]: INFO networking_nsxv3.common.synchronization [req-f7005849-6f08-4bfa-876a-221252c0b966 req-90e3b370-5383-4238-8fe8-a1cad0c6b7a9 service nova] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 755.206798] env[65106]: INFO networking_nsxv3.common.synchronization [req-f7005849-6f08-4bfa-876a-221252c0b966 req-90e3b370-5383-4238-8fe8-a1cad0c6b7a9 service nova] Enqueued Resource ID: 1a085216-4541-482c-ab20-05dd664ea3a4 with Priority: HIGHEST for action port [ 755.207540] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_rules [ 755.207713] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 755.207823] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a085216-4541-482c-ab20-05dd664ea3a4 with Priority: HIGHEST for action port [ 755.208142] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.208272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.208325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.208598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.208681] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.209576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.209723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.209833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.209953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.211434] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.212904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.212904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.212904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.213663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.213811] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.215764] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a085216-4541-482c-ab20-05dd664ea3a4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.215764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a085216-4541-482c-ab20-05dd664ea3a4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.215764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a085216-4541-482c-ab20-05dd664ea3a4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.216728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a085216-4541-482c-ab20-05dd664ea3a4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.216728] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a085216-4541-482c-ab20-05dd664ea3a4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.708472] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.708709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.708709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.708886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.709140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.709140] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 755.719310] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.720562] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.720760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.722323] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a085216-4541-482c-ab20-05dd664ea3a4 with status ACTIVE [ 755.722551] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.722783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.723094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.723210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.723298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.723490] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.723618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.723691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.723954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.723954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.724173] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.724539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.724539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.724539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.724539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.724713] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a085216-4541-482c-ab20-05dd664ea3a4 is going to be updated. [ 755.753480] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.753764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.753764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.753964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.754127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.754294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a085216-4541-482c-ab20-05dd664ea3a4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.755722] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.755722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.755722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.755906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.755968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.769712] env[65106]: INFO networking_nsxv3.common.synchronization [None req-88d46c48-f75a-4e5a-a875-4c0bad644eff None None] Enqueued Resource ID: 0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed with Priority: HIGHEST for action port [ 755.771550] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 755.771677] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed with Priority: HIGHEST for action port [ 755.771892] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.772047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.772135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.772377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.772451] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.222048] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.275130] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed [ 756.275493] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.275729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.275818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.276121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.276269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.276415] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed already deleted. [ 756.276554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0391dfa4-f0ae-4b89-a9d0-83c27eadb3ed" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.354270] env[65106]: INFO networking_nsxv3.common.synchronization [req-748c14bc-59e8-4cd0-b6dd-8e81b6e0fc50 req-76562061-bf21-4200-aa50-3c5c0590f565 tempest-ServersTestFqdnHostnames-225825114 tempest-ServersTestFqdnHostnames-225825114-project-member] Enqueued Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_members [ 756.355020] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_members [ 756.355463] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.355599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.355703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.356015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.356385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.356385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.356385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.358413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.358560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.358721] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.729023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.729023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.729023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.729023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.729023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.729023] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be created. [ 756.752611] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.752805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.752853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.753082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.753248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.764112] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: UNINITIALIZED for 2s [ 756.862252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.862252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.862454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.862636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.862769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.862994] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.863159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.863272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.863405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.863483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.863569] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 already deleted. [ 756.863651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.128846] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.129168] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-603" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.129353] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-603" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.129749] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-603" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.130108] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.130313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.130470] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.130782] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.130945] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.131173] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.131352] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.131509] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.131662] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.131786] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.131893] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.132052] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.152424] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.152578] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.152790] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.152950] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-603" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.153389] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-15b60dfb-e666-4804-916b-51cd763fc42c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.153578] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-15b60dfb-e666-4804-916b-51cd763fc42c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.153713] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-15b60dfb-e666-4804-916b-51cd763fc42c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.154043] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-15b60dfb-e666-4804-916b-51cd763fc42c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.154216] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b60dfb-e666-4804-916b-51cd763fc42c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.657426] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.657426] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.657731] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.657766] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.657913] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.658116] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 15b60dfb-e666-4804-916b-51cd763fc42c not found, creating... [ 757.658481] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.658693] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.658817] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.659114] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.659285] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.659579] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.662019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.662019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.662019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.662019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.662019] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 15b60dfb-e666-4804-916b-51cd763fc42c is going to be created. [ 757.683835] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.684127] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.684206] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.684472] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.684698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.684964] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-15b60dfb-e666-4804-916b-51cd763fc42c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.785693] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 757.785996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.786257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.786501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.786714] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.786855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.786979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.787615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.787615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.787749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.787798] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.937192] env[65106]: INFO networking_nsxv3.common.synchronization [None req-964f2f26-c7fa-4e63-9db9-2ab058ec26d9 None None] Enqueued Resource ID: 02abd252-9618-4e12-9996-fc700f2011c9 with Priority: HIGHEST for action port [ 757.937192] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02abd252-9618-4e12-9996-fc700f2011c9 with Priority: HIGHEST for action port [ 757.937529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-02abd252-9618-4e12-9996-fc700f2011c9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.937529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02abd252-9618-4e12-9996-fc700f2011c9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.937529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02abd252-9618-4e12-9996-fc700f2011c9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.938803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02abd252-9618-4e12-9996-fc700f2011c9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.938803] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02abd252-9618-4e12-9996-fc700f2011c9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.293716] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.293839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.293916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.294205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.294406] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.294503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.294540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.294821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.294882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.294951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.296451] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.296451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.296451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.296451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.296451] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.296451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.296451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.296451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.296451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.296451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.296451] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.440401] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02abd252-9618-4e12-9996-fc700f2011c9 [ 758.440675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.440803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.440876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.441126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.441222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.441321] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02abd252-9618-4e12-9996-fc700f2011c9 already deleted. [ 758.441630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02abd252-9618-4e12-9996-fc700f2011c9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.520694] env[65106]: INFO networking_nsxv3.common.synchronization [req-748c14bc-59e8-4cd0-b6dd-8e81b6e0fc50 req-fbc3f393-cef0-4ec6-89d6-1ecb9237ea62 service nova] Enqueued Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_rules [ 758.521671] env[65106]: INFO networking_nsxv3.common.synchronization [req-748c14bc-59e8-4cd0-b6dd-8e81b6e0fc50 req-fbc3f393-cef0-4ec6-89d6-1ecb9237ea62 service nova] Enqueued Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_members [ 758.521671] env[65106]: INFO networking_nsxv3.common.synchronization [req-748c14bc-59e8-4cd0-b6dd-8e81b6e0fc50 req-fbc3f393-cef0-4ec6-89d6-1ecb9237ea62 service nova] Enqueued Resource ID: 15b60dfb-e666-4804-916b-51cd763fc42c with Priority: HIGHEST for action port [ 758.521800] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_rules [ 758.521902] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_members [ 758.522023] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15b60dfb-e666-4804-916b-51cd763fc42c with Priority: HIGHEST for action port [ 758.522330] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.522464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.522546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.522801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.522908] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.524807] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.524932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.525059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.525379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.525617] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.525772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.525903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.526111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.526202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.526300] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.527202] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-15b60dfb-e666-4804-916b-51cd763fc42c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.527313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15b60dfb-e666-4804-916b-51cd763fc42c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.527476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15b60dfb-e666-4804-916b-51cd763fc42c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.527563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15b60dfb-e666-4804-916b-51cd763fc42c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.527641] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15b60dfb-e666-4804-916b-51cd763fc42c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.776557] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: SUCCESS [ 758.777132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.777389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.777622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.777819] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.777938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.778014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.778175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.778257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.778359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.778459] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.802421] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143c4b09-e4ef-4609-8ff0-863f1dce9402: rpc.has_security_group_logging(os_id): False [ 758.820818] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.820818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.820818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.820818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.820818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.820818] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.820818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.820818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.821909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.821909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.821909] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.821909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.821909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.822147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.822231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.823038] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.823038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.823038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.823038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.823038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.823038] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 758.930800] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.931035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.931035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.931285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.931483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.960462] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 759.025566] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.025801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.030558] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.031663] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15b60dfb-e666-4804-916b-51cd763fc42c with status ACTIVE [ 759.032029] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.032213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.032442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.032573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.032653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.032927] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.033102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.033102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.033247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.033385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.033540] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.033721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.033817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.033932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.034153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.034153] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15b60dfb-e666-4804-916b-51cd763fc42c is going to be updated. [ 759.069148] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.069434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.069434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.069583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.069683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.069857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15b60dfb-e666-4804-916b-51cd763fc42c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.281834] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.282062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.282062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.282372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.282568] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.282740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.282837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.283069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.283187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.283303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.283836] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.283836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.283836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.283995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.284092] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.284226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.284316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.284501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.284599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.284709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.284836] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.536779] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.677457] env[65106]: INFO networking_nsxv3.common.synchronization [req-01bebc00-f04c-459b-96ce-b62c80df8734 req-8871a395-7a5c-4a18-9ebb-eeed33e7a8ee tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 759.678503] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 759.678943] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.679154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.679250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.679706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.680085] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.680085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.680212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.680403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.680520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.680647] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.787505] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 108c3320-1bbb-4cb7-a30a-c66ddca2d037: rpc.has_security_group_logging(os_id): False [ 759.811432] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.811432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.811432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.811598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.811703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.814997] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.814997] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.814997] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.814997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.815487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.815487] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be created. [ 759.886587] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.886728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.886812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.887229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.887411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.905861] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: IN_PROGRESS for 2s [ 760.040815] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.040996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.041268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.041802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.042360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.042360] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 is going to be created. [ 760.084185] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.084185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.084185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.084592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.084678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.099911] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 in Status: UNINITIALIZED for 2s [ 760.183532] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.183705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.183826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.183993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.184102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.184306] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.184435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.184504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.184669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.184746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.184861] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc already deleted. [ 760.184953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.211548] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.211881] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.212054] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.212392] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.212746] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.212952] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.213104] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.213354] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.213525] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.213837] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.213953] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.214102] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.214203] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.214317] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.214416] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.214541] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.241030] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.241217] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.241404] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.241586] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.242011] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-83d19d48-bae2-49e3-ba44-93e45c3513ce taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.242177] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-83d19d48-bae2-49e3-ba44-93e45c3513ce" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.242345] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-83d19d48-bae2-49e3-ba44-93e45c3513ce" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.242826] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-83d19d48-bae2-49e3-ba44-93e45c3513ce" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.243607] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83d19d48-bae2-49e3-ba44-93e45c3513ce',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.746394] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.746687] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.746859] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.747190] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.747342] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.747510] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 83d19d48-bae2-49e3-ba44-93e45c3513ce not found, creating... [ 760.747787] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.748036] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.748226] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.748496] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.748650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.749033] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.749161] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.749343] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.749577] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.749743] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.749902] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 83d19d48-bae2-49e3-ba44-93e45c3513ce is going to be created. [ 760.775079] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.775385] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.775543] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.775805] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.776128] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.776371] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-83d19d48-bae2-49e3-ba44-93e45c3513ce" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.977232] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 760.977527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.492791] env[65106]: INFO networking_nsxv3.common.synchronization [req-01bebc00-f04c-459b-96ce-b62c80df8734 req-7bbd56fa-deda-40d7-8d64-552fd3056511 service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 761.493076] env[65106]: INFO networking_nsxv3.common.synchronization [req-01bebc00-f04c-459b-96ce-b62c80df8734 req-7bbd56fa-deda-40d7-8d64-552fd3056511 service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 761.493231] env[65106]: INFO networking_nsxv3.common.synchronization [req-01bebc00-f04c-459b-96ce-b62c80df8734 req-7bbd56fa-deda-40d7-8d64-552fd3056511 service nova] Enqueued Resource ID: 83d19d48-bae2-49e3-ba44-93e45c3513ce with Priority: HIGHEST for action port [ 761.493971] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 761.494389] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 761.494389] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83d19d48-bae2-49e3-ba44-93e45c3513ce with Priority: HIGHEST for action port [ 761.494586] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.494822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.494822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.495231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.495231] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.496574] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.496709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.497223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.497749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.497749] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.497855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.497855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.499034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.499034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.499034] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.499189] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-83d19d48-bae2-49e3-ba44-93e45c3513ce taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.499189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83d19d48-bae2-49e3-ba44-93e45c3513ce" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.499318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83d19d48-bae2-49e3-ba44-93e45c3513ce" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.499597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83d19d48-bae2-49e3-ba44-93e45c3513ce" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.499597] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83d19d48-bae2-49e3-ba44-93e45c3513ce',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.919610] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: SUCCESS [ 761.922629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.979602] env[65106]: INFO networking_nsxv3.common.synchronization [req-8113a17b-c917-4ca0-afe0-a78b0c94822d req-1fcd7aaa-84c0-404b-86f9-b90ff3a2f966 tempest-InstanceActionsTestJSON-2090033735 tempest-InstanceActionsTestJSON-2090033735-project-member] Enqueued Resource ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 with Priority: HIGHEST for action security_group_members [ 761.980486] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 with Priority: HIGHEST for action security_group_members [ 761.980486] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.980640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.980690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.980958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.983252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.983364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.983482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.983604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.983786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.983861] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff5ba0af-d21f-4f03-b95d-0c41f57292b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.002039] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.002532] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.002532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.002822] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83d19d48-bae2-49e3-ba44-93e45c3513ce with status ACTIVE [ 762.003012] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.003139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.003215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.003466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.003562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.003754] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.003879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.003929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.004124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.004214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.004409] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.005571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.008662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.009883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.010877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.010877] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83d19d48-bae2-49e3-ba44-93e45c3513ce is going to be updated. [ 762.038428] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.038646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.038734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.038951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.039109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.039295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83d19d48-bae2-49e3-ba44-93e45c3513ce" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.109855] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 in Status: SUCCESS [ 762.110154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.110536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.110624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.111125] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.111125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.111125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.111287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.111389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.111539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.111592] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.486690] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.487570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.487570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.487778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.487990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.488295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.488436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.488526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.488833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.488947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.489238] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 already deleted. [ 762.489341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.514163] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.613979] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.806486] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-894 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.806774] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-894" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.806938] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-894" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.807409] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-894" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.807840] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.808132] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.809058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.809058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.809058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.809355] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.809548] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.809737] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.809927] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.810159] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.810358] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.810576] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.837073] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.837073] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.837073] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.837073] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-894" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.837485] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-5a6838a3-5ef0-4893-a01d-851cd404599c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.837629] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-5a6838a3-5ef0-4893-a01d-851cd404599c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.837712] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-5a6838a3-5ef0-4893-a01d-851cd404599c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.838564] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-5a6838a3-5ef0-4893-a01d-851cd404599c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.838564] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a6838a3-5ef0-4893-a01d-851cd404599c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.016583] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.016968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.016968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.017178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.017393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.017536] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be created. [ 763.046918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.047317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.047439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.047700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.047902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.059012] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: UNINITIALIZED for 2s [ 763.116104] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbe5502d-c241-4f70-a5e4-91617fb44bf1: rpc.has_security_group_logging(os_id): False [ 763.134943] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.135156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.135202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.135407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.135501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.135743] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.135843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.135929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.136112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.136145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.136217] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 is going to be created. [ 763.206335] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.206335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.206335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.206335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.206335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.217663] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 in Status: IN_PROGRESS for 2s [ 763.342149] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.342149] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.342149] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.342149] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.342149] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.342462] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 5a6838a3-5ef0-4893-a01d-851cd404599c not found, creating... [ 763.342494] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.342826] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.343013] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.343317] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.343489] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.343855] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.344075] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.344243] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.344505] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.344671] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.344833] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 5a6838a3-5ef0-4893-a01d-851cd404599c is going to be created. [ 763.374817] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.375452] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.375452] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.375718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.376058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.376266] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-5a6838a3-5ef0-4893-a01d-851cd404599c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.145499] env[65106]: INFO networking_nsxv3.common.synchronization [req-8113a17b-c917-4ca0-afe0-a78b0c94822d req-3dfd3934-23ea-4043-94f0-fc6b2c5bda14 service nova] Enqueued Resource ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 with Priority: HIGHEST for action security_group_rules [ 764.145825] env[65106]: INFO networking_nsxv3.common.synchronization [req-8113a17b-c917-4ca0-afe0-a78b0c94822d req-3dfd3934-23ea-4043-94f0-fc6b2c5bda14 service nova] Enqueued Resource ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 with Priority: HIGHEST for action security_group_members [ 764.145825] env[65106]: INFO networking_nsxv3.common.synchronization [req-8113a17b-c917-4ca0-afe0-a78b0c94822d req-3dfd3934-23ea-4043-94f0-fc6b2c5bda14 service nova] Enqueued Resource ID: 5a6838a3-5ef0-4893-a01d-851cd404599c with Priority: HIGHEST for action port [ 764.146620] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 with Priority: HIGHEST for action security_group_rules [ 764.146620] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 with Priority: HIGHEST for action security_group_members [ 764.146762] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a6838a3-5ef0-4893-a01d-851cd404599c with Priority: HIGHEST for action port [ 764.147520] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ff5ba0af-d21f-4f03-b95d-0c41f57292b6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.147520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.147520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.147816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.147897] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ff5ba0af-d21f-4f03-b95d-0c41f57292b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.149346] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.149346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.149346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.150037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.150234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.150375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.150474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.150862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.150862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.150933] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff5ba0af-d21f-4f03-b95d-0c41f57292b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.151959] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a6838a3-5ef0-4893-a01d-851cd404599c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.152104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a6838a3-5ef0-4893-a01d-851cd404599c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.152197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a6838a3-5ef0-4893-a01d-851cd404599c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.152383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a6838a3-5ef0-4893-a01d-851cd404599c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.152554] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a6838a3-5ef0-4893-a01d-851cd404599c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.655562] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.655691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.655880] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ff5ba0af-d21f-4f03-b95d-0c41f57292b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.656785] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a6838a3-5ef0-4893-a01d-851cd404599c with status ACTIVE [ 764.656975] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.657091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.657157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.657357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.657442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.657608] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.657701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.657762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.657909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.657991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.658189] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.658283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.658343] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.658477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.658549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.658631] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a6838a3-5ef0-4893-a01d-851cd404599c is going to be updated. [ 764.691923] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.692084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.692170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.692390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.692540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.692975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a6838a3-5ef0-4893-a01d-851cd404599c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.919574] env[65106]: INFO networking_nsxv3.common.synchronization [None req-a511d2e6-09d3-40f7-9a89-114b0840dcf6 None None] Enqueued Resource ID: fc3bd005-47d2-4b31-88f6-d83a93e0904d with Priority: HIGHEST for action port [ 764.920518] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc3bd005-47d2-4b31-88f6-d83a93e0904d with Priority: HIGHEST for action port [ 764.921007] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc3bd005-47d2-4b31-88f6-d83a93e0904d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.921210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc3bd005-47d2-4b31-88f6-d83a93e0904d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.921314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc3bd005-47d2-4b31-88f6-d83a93e0904d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.921639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc3bd005-47d2-4b31-88f6-d83a93e0904d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.921755] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc3bd005-47d2-4b31-88f6-d83a93e0904d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.073614] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 765.073897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.074108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.074408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.074639] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.074792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.074864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.075080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.075197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.075285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.075397] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.162488] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ff5ba0af-d21f-4f03-b95d-0c41f57292b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.232325] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 in Status: SUCCESS [ 765.232325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.403739] env[65106]: INFO networking_nsxv3.common.synchronization [req-4516cef0-9d91-4649-802d-3b99e1aeb078 req-aaff4dba-7189-45b0-b1b1-aabd6c3cecec tempest-AttachInterfacesV270Test-1052302337 tempest-AttachInterfacesV270Test-1052302337-project-member] Enqueued Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGHEST for action security_group_members [ 765.404843] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGHEST for action security_group_members [ 765.404843] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.404843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.404843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.405171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.405378] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.405378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.406247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.406247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.406247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.406247] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.425606] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc3bd005-47d2-4b31-88f6-d83a93e0904d [ 765.426523] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.426613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.426692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.426911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.426995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.427254] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc3bd005-47d2-4b31-88f6-d83a93e0904d already deleted. [ 765.427254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc3bd005-47d2-4b31-88f6-d83a93e0904d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.579459] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.579459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.579459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.579459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.579459] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.579459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.579459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.579459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.579459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.579459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.579908] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.579908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.579908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.579908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.580109] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.580109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.580109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.580573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.580573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.580573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.580573] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.666113] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.667031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.667031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.667031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.667284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.668339] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 is going to be created. [ 765.694738] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.695375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.695375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.695375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.695375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.705492] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 in Status: UNINITIALIZED for 2s [ 765.910857] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.911046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.911114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.911313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.911404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.912475] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.914280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.914280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.914280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.914280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.914280] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e already deleted. [ 765.914280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.918351] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-376 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.918351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-376" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.918351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-376" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.918351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-376" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.918351] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.918351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.918351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.918351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.918351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.918351] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.918351] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 765.918351] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 765.918351] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 765.918993] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 765.918993] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 765.918993] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 765.938944] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 765.939039] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 765.939165] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 765.939338] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-376" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.939643] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-d60e4803-3781-4674-9f29-64f6a80c4848 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.939806] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-d60e4803-3781-4674-9f29-64f6a80c4848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.939909] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-d60e4803-3781-4674-9f29-64f6a80c4848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.940238] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-d60e4803-3781-4674-9f29-64f6a80c4848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.940379] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d60e4803-3781-4674-9f29-64f6a80c4848',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.084152] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00fc8ecc-2b12-478d-8a50-43a7183605bc: rpc.has_security_group_logging(os_id): False [ 766.106187] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.106450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.106530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.106877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.107037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.107476] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.107601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.107693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.107947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.108052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.108286] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.108361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.108440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.108549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.108623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.108799] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.108898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.108964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.109113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.109186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.109271] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be created. [ 766.204749] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.204749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.204749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.204749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.204749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.228462] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 766.445829] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.446390] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.446485] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.446794] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.446943] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.447150] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port d60e4803-3781-4674-9f29-64f6a80c4848 not found, creating... [ 766.447458] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.447644] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.447759] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.448026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.448393] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.448863] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.448863] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.448863] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.449315] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.449315] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.449529] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: d60e4803-3781-4674-9f29-64f6a80c4848 is going to be created. [ 766.470484] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.470711] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.471650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.471650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.471650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.471858] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-d60e4803-3781-4674-9f29-64f6a80c4848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.353523] env[65106]: INFO networking_nsxv3.common.synchronization [req-4516cef0-9d91-4649-802d-3b99e1aeb078 req-ca313bca-035b-4331-af35-806b8c06295d service nova] Enqueued Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGHEST for action security_group_rules [ 767.353523] env[65106]: INFO networking_nsxv3.common.synchronization [req-4516cef0-9d91-4649-802d-3b99e1aeb078 req-ca313bca-035b-4331-af35-806b8c06295d service nova] Enqueued Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGHEST for action security_group_members [ 767.353523] env[65106]: INFO networking_nsxv3.common.synchronization [req-4516cef0-9d91-4649-802d-3b99e1aeb078 req-ca313bca-035b-4331-af35-806b8c06295d service nova] Enqueued Resource ID: d60e4803-3781-4674-9f29-64f6a80c4848 with Priority: HIGHEST for action port [ 767.353523] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGHEST for action security_group_rules [ 767.354072] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGHEST for action security_group_members [ 767.354072] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d60e4803-3781-4674-9f29-64f6a80c4848 with Priority: HIGHEST for action port [ 767.357207] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.357207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.357207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.357207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.357207] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.357410] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.357913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.357913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.357913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.359102] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.359834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.359834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.359834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.359834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.359834] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.360580] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d60e4803-3781-4674-9f29-64f6a80c4848 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.361148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d60e4803-3781-4674-9f29-64f6a80c4848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.361148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d60e4803-3781-4674-9f29-64f6a80c4848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.361148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d60e4803-3781-4674-9f29-64f6a80c4848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.361148] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d60e4803-3781-4674-9f29-64f6a80c4848',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.454064] env[65106]: INFO networking_nsxv3.common.synchronization [None req-e6719b7f-ab0e-405d-88a9-524d3f9ca2b3 None None] Enqueued Resource ID: d94076ad-0f5a-49d5-9cb0-a2148be69019 with Priority: HIGHEST for action port [ 767.454064] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d94076ad-0f5a-49d5-9cb0-a2148be69019 with Priority: HIGHEST for action port [ 767.454064] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d94076ad-0f5a-49d5-9cb0-a2148be69019 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.454064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d94076ad-0f5a-49d5-9cb0-a2148be69019" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.454064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d94076ad-0f5a-49d5-9cb0-a2148be69019" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.454064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d94076ad-0f5a-49d5-9cb0-a2148be69019" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.454064] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d94076ad-0f5a-49d5-9cb0-a2148be69019',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.710209] env[65106]: INFO networking_nsxv3.common.synchronization [req-c6c88e8b-0576-4b8c-9908-a40a28efd939 req-b405f42a-05a1-42e7-9e76-ec1ab26465ab tempest-MigrationsAdminTest-232602271 tempest-MigrationsAdminTest-232602271-project-member] Enqueued Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 767.710951] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 767.711391] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.711739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.711739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.711960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.712185] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.712328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.712420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.712958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.712958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.712958] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.717917] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 in Status: SUCCESS [ 767.717917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.718191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.718347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.718489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.718594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.718650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.718864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.718864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.718959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.719056] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ff5ba0af-d21f-4f03-b95d-0c41f57292b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.863194] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.863371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.863535] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.865295] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d60e4803-3781-4674-9f29-64f6a80c4848 with status ACTIVE [ 767.865295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.865295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.865295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.865295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.865295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.865576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.865576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.865576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.865720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.865720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.865918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.866525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.866677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.866863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.867746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.867746] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d60e4803-3781-4674-9f29-64f6a80c4848 is going to be updated. [ 767.890441] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.890579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.890636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.890880] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.891030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.891189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d60e4803-3781-4674-9f29-64f6a80c4848" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.955275] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d94076ad-0f5a-49d5-9cb0-a2148be69019 [ 767.955475] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.955693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.955693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.955932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.955994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.956117] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d94076ad-0f5a-49d5-9cb0-a2148be69019 already deleted. [ 767.956187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d94076ad-0f5a-49d5-9cb0-a2148be69019" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.160706] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.161537] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.161537] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.161537] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.161670] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.161739] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.161856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.162385] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.162586] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.162873] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.163032] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.163236] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.163412] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.163564] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.163764] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.163977] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.184717] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.187117] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.187117] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.187117] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.187117] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-2cef112e-9725-4015-a746-c9f35e3e32e8 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.187117] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-2cef112e-9725-4015-a746-c9f35e3e32e8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.187117] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-2cef112e-9725-4015-a746-c9f35e3e32e8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.187117] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-2cef112e-9725-4015-a746-c9f35e3e32e8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.187117] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cef112e-9725-4015-a746-c9f35e3e32e8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.219256] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.222442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.222442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.222442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.222442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.222442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.222727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.222727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.222727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.222886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.222886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.223028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.223148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.223222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.223557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.223557] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.223690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.223690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.223775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.223866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.223948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.224068] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ff5ba0af-d21f-4f03-b95d-0c41f57292b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.241981] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 768.242241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.370479] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.689487] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.689487] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.689601] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.689871] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.690024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.690169] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 2cef112e-9725-4015-a746-c9f35e3e32e8 not found, creating... [ 768.690415] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.690563] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.690698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.690937] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.691076] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.691377] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.691543] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.691655] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.691856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.691981] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.692122] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 2cef112e-9725-4015-a746-c9f35e3e32e8 is going to be created. [ 768.714440] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.714647] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.714762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.715069] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.715300] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.715513] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-2cef112e-9725-4015-a746-c9f35e3e32e8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.721368] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.727448] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ff5ba0af-d21f-4f03-b95d-0c41f57292b6: rpc.has_security_group_logging(os_id): False [ 768.745788] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.745961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.745999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.746207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.746329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.746583] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.746690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.746764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.746956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.747050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.747232] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.747359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.747437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.747583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.747657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.747835] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.747927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.747988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.748137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.748210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.748291] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 is going to be created. [ 768.834447] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.834686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.834795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.835107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.835387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.861247] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 in Status: IN_PROGRESS for 2s [ 768.873287] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.873484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.873557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.874089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.874089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.874089] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e is going to be created. [ 768.919119] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.919119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.919119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.919119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.919119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.929951] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e in Status: UNINITIALIZED for 2s [ 769.223302] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.223451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.223520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.223792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.223901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.223997] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c is going to be updated. [ 769.265421] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.265651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.265784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.266531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.266531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.279640] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: IN_PROGRESS for 2s [ 769.485522] env[65106]: INFO networking_nsxv3.common.synchronization [req-c6c88e8b-0576-4b8c-9908-a40a28efd939 req-276877d4-62ad-4c41-ae84-55393b77afd6 service nova] Enqueued Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_rules [ 769.485878] env[65106]: INFO networking_nsxv3.common.synchronization [req-c6c88e8b-0576-4b8c-9908-a40a28efd939 req-276877d4-62ad-4c41-ae84-55393b77afd6 service nova] Enqueued Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 769.485982] env[65106]: INFO networking_nsxv3.common.synchronization [req-c6c88e8b-0576-4b8c-9908-a40a28efd939 req-276877d4-62ad-4c41-ae84-55393b77afd6 service nova] Enqueued Resource ID: 2cef112e-9725-4015-a746-c9f35e3e32e8 with Priority: HIGHEST for action port [ 769.486729] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_rules [ 769.487951] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 769.487951] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cef112e-9725-4015-a746-c9f35e3e32e8 with Priority: HIGHEST for action port [ 769.487951] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.487951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.487951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.487951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.487951] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.488764] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.488869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.489519] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cef112e-9725-4015-a746-c9f35e3e32e8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.489664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cef112e-9725-4015-a746-c9f35e3e32e8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.489933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cef112e-9725-4015-a746-c9f35e3e32e8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.490225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cef112e-9725-4015-a746-c9f35e3e32e8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.490368] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cef112e-9725-4015-a746-c9f35e3e32e8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.857792] env[65106]: INFO networking_nsxv3.common.synchronization [None req-3c3a321d-1007-4fb9-9093-c6aa6b921134 None None] Enqueued Resource ID: 4dbb84a5-f328-4ac5-88af-a692d05bf6a0 with Priority: HIGHEST for action port [ 769.858082] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dbb84a5-f328-4ac5-88af-a692d05bf6a0 with Priority: HIGHEST for action port [ 769.858820] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-4dbb84a5-f328-4ac5-88af-a692d05bf6a0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.860044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4dbb84a5-f328-4ac5-88af-a692d05bf6a0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.860044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4dbb84a5-f328-4ac5-88af-a692d05bf6a0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.860044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4dbb84a5-f328-4ac5-88af-a692d05bf6a0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.860044] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4dbb84a5-f328-4ac5-88af-a692d05bf6a0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.992738] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cef112e-9725-4015-a746-c9f35e3e32e8 with status ACTIVE [ 769.993015] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.995031] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.995031] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.995031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.999355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.999590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.000384] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cef112e-9725-4015-a746-c9f35e3e32e8 is going to be updated. [ 770.001696] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.003197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.041372] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.042767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.043031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.043414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.043661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.043947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cef112e-9725-4015-a746-c9f35e3e32e8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.362301] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4dbb84a5-f328-4ac5-88af-a692d05bf6a0 [ 770.362844] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.362844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.362844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.362988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.363041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.363146] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4dbb84a5-f328-4ac5-88af-a692d05bf6a0 already deleted. [ 770.363214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4dbb84a5-f328-4ac5-88af-a692d05bf6a0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.446830] env[65106]: INFO networking_nsxv3.common.synchronization [req-1bab2a19-cd46-43cc-91d0-4f3b024271c4 req-da90c6d0-a542-4d05-8504-94a2d370df6b tempest-ImagesOneServerNegativeTestJSON-531782934 tempest-ImagesOneServerNegativeTestJSON-531782934-project-member] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 770.446830] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 770.447576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.447740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.447984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.448212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.448595] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.448709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.448770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.448963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.449056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.449151] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.876844] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 in Status: SUCCESS [ 770.877361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.886947] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-71 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.888951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.888951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.888951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.888951] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.888951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.888951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.888951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.889299] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.889299] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.889394] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 770.889488] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 770.889687] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 770.889687] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 770.889788] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 770.889888] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 770.911321] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 770.911480] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 770.913015] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 770.913015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.913015] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-2351810f-acc6-4170-ab26-38d6829a5165 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.913015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-2351810f-acc6-4170-ab26-38d6829a5165" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.913015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-2351810f-acc6-4170-ab26-38d6829a5165" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.913015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-2351810f-acc6-4170-ab26-38d6829a5165" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.913015] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2351810f-acc6-4170-ab26-38d6829a5165',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.959020] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e in Status: SUCCESS [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.959020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.959020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.959020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.959020] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 770.959691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.959691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.959691] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.959691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.959839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.960151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.960683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.960879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.960959] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.999196] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.999196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.999196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.999196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.999196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.015188] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 771.293165] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: SUCCESS [ 771.293165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.293165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.293408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.293408] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.293550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.293550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.293751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.293869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.294024] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.354018] env[65106]: INFO networking_nsxv3.common.synchronization [req-89889791-af02-49f0-afbc-59618967f9a3 req-35234d6c-7e6d-4f54-a843-c9cdde7dd381 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 771.354209] env[65106]: INFO networking_nsxv3.common.synchronization [req-89889791-af02-49f0-afbc-59618967f9a3 req-35234d6c-7e6d-4f54-a843-c9cdde7dd381 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 771.354748] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 771.354884] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 771.355439] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.357031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.357031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.357031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.357031] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.357031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.357031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.357031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.357031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.357031] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.357397] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.357397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.357496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.357659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.357804] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.357897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.357956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.358422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.358569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.358860] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.412071] env[65106]: INFO networking_nsxv3.common.synchronization [req-89889791-af02-49f0-afbc-59618967f9a3 req-35234d6c-7e6d-4f54-a843-c9cdde7dd381 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 771.412231] env[65106]: INFO networking_nsxv3.common.synchronization [req-89889791-af02-49f0-afbc-59618967f9a3 req-35234d6c-7e6d-4f54-a843-c9cdde7dd381 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 771.412346] env[65106]: INFO networking_nsxv3.common.synchronization [req-89889791-af02-49f0-afbc-59618967f9a3 req-35234d6c-7e6d-4f54-a843-c9cdde7dd381 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_rules [ 771.412471] env[65106]: INFO networking_nsxv3.common.synchronization [req-89889791-af02-49f0-afbc-59618967f9a3 req-35234d6c-7e6d-4f54-a843-c9cdde7dd381 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 771.412589] env[65106]: INFO networking_nsxv3.common.synchronization [req-89889791-af02-49f0-afbc-59618967f9a3 req-35234d6c-7e6d-4f54-a843-c9cdde7dd381 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 98b466ee-a460-4056-85d6-d93a61a587f2 with Priority: HIGHEST for action port [ 771.413332] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 771.413332] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_rules [ 771.413462] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98b466ee-a460-4056-85d6-d93a61a587f2 with Priority: HIGHEST for action port [ 771.413496] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 771.413661] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 771.413850] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.414091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.414091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.414830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.414830] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.415179] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.415295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.415513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.415615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.415647] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.416444] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-98b466ee-a460-4056-85d6-d93a61a587f2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.416752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.416752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.416752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.416884] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98b466ee-a460-4056-85d6-d93a61a587f2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.417550] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.417645] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.418171] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.418171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.418891] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.419076] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.419246] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.419480] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.419621] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.420083] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 2351810f-acc6-4170-ab26-38d6829a5165 not found, creating... [ 771.420083] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.420213] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.420290] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.420489] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.420616] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.422583] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.422583] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.422583] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.422583] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.422583] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.422583] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 2351810f-acc6-4170-ab26-38d6829a5165 is going to be created. [ 771.445644] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.445856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.445969] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.446302] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.446524] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.446740] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-2351810f-acc6-4170-ab26-38d6829a5165" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.466024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.466024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.466024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.466024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.466024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.466729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.466729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.466729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.466729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.466729] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.796180] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.860684] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.862928] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.918592] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.918928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.918973] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.919111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.919173] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98b466ee-a460-4056-85d6-d93a61a587f2 with status ACTIVE [ 771.919435] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.919523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.919558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.919746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.919829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.919988] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.920094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.920154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.920311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.920386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.920559] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.920649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.920727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.920981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.921093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.921178] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98b466ee-a460-4056-85d6-d93a61a587f2 is going to be updated. [ 771.946329] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.946414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.947199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.948250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.948478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.948660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.969737] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e: rpc.has_security_group_logging(os_id): False [ 771.993302] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.993651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.994134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.994248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.994443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.995056] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.995056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.995056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.995249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.995286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.996512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.996512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.996512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.996512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.996512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.996512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.996512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.996512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.996512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.996902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.996902] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e is going to be created. [ 772.087526] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.087741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.087813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.088063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.088291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.116600] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e in Status: IN_PROGRESS for 2s [ 772.251284] env[65106]: INFO networking_nsxv3.common.synchronization [req-1bab2a19-cd46-43cc-91d0-4f3b024271c4 req-9f42f03d-672c-4f09-b8cc-eb9d7c33f780 service nova] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_rules [ 772.251284] env[65106]: INFO networking_nsxv3.common.synchronization [req-1bab2a19-cd46-43cc-91d0-4f3b024271c4 req-9f42f03d-672c-4f09-b8cc-eb9d7c33f780 service nova] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 772.251428] env[65106]: INFO networking_nsxv3.common.synchronization [req-1bab2a19-cd46-43cc-91d0-4f3b024271c4 req-9f42f03d-672c-4f09-b8cc-eb9d7c33f780 service nova] Enqueued Resource ID: 2351810f-acc6-4170-ab26-38d6829a5165 with Priority: HIGHEST for action port [ 772.252043] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_rules [ 772.252188] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 772.252328] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2351810f-acc6-4170-ab26-38d6829a5165 with Priority: HIGHEST for action port [ 772.252571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.252694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.252760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.253031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.253121] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.256033] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.258929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.259491] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2351810f-acc6-4170-ab26-38d6829a5165 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.259710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2351810f-acc6-4170-ab26-38d6829a5165" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.259804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2351810f-acc6-4170-ab26-38d6829a5165" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.260082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2351810f-acc6-4170-ab26-38d6829a5165" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.260152] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2351810f-acc6-4170-ab26-38d6829a5165',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.299059] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.364711] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.366219] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.502345] env[65106]: INFO networking_nsxv3.common.synchronization [None req-fb036862-dcf0-44c1-91ab-4e9ade1b3eab None None] Enqueued Resource ID: 92fe927b-99d1-48ad-9059-3a4bc8943294 with Priority: HIGHEST for action port [ 772.503024] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92fe927b-99d1-48ad-9059-3a4bc8943294 with Priority: HIGHEST for action port [ 772.503410] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-92fe927b-99d1-48ad-9059-3a4bc8943294 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.503554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92fe927b-99d1-48ad-9059-3a4bc8943294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.503824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92fe927b-99d1-48ad-9059-3a4bc8943294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.503920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92fe927b-99d1-48ad-9059-3a4bc8943294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.503978] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92fe927b-99d1-48ad-9059-3a4bc8943294',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.762871] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.763314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.763515] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2351810f-acc6-4170-ab26-38d6829a5165 with status ACTIVE [ 772.763759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.763944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.764060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.764328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.764684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.764684] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.764828] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.764925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.765155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.765364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.765532] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.765668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.765758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.765984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.765984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.766290] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2351810f-acc6-4170-ab26-38d6829a5165 is going to be updated. [ 772.798133] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.798363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.798435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.798666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.798808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.798982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2351810f-acc6-4170-ab26-38d6829a5165" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.801697] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.801946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.801946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.802125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.802954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.803065] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c is going to be updated. [ 772.844872] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.845155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.845271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.845619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.845869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.862971] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: IN_PROGRESS for 2s [ 772.870561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.870561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.870561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.870561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.870561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.870561] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 772.872300] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.872507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.872617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.872907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.873271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.873415] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 is going to be created. [ 772.910553] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.910906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.910995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.911597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.911834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.914076] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.914230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.914335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.914838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.915500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.933684] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 772.934658] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: UNINITIALIZED for 2s [ 773.011252] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92fe927b-99d1-48ad-9059-3a4bc8943294 [ 773.011696] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.011696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.011821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.012062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.012216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.012752] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92fe927b-99d1-48ad-9059-3a4bc8943294 already deleted. [ 773.012752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92fe927b-99d1-48ad-9059-3a4bc8943294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.028398] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 773.028596] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd deletion is rescheduled due to dependency. [ 773.028723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.028914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.029179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.029492] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.029624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.029696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.029911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.030018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.030120] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.533913] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.036227] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.136045] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e in Status: SUCCESS [ 774.136045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.541168] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.541325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.541409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.541706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.541836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.541958] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 774.588673] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.588809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.589085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.589618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.589618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.611804] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 774.874708] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: SUCCESS [ 774.875458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.875643] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.875878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.876221] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.876410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.876410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.876628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.876723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.876827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.876927] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.951890] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 774.952132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.952320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.952577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.952753] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.952972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.953080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.953244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.953327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.953431] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.956187] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: SUCCESS [ 774.956390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.956904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.957555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.957845] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.957972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.958085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.958328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.958328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.958428] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.379328] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.379646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.379646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.379811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.379962] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.380076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.380138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.380288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.380365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.380449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.380595] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.380739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.380739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.380911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.381011] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.381110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.382472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.382472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.382472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.382472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.382472] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.461397] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.462486] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.885604] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 49f44a93-5686-4d9d-984b-4efb2550596c: rpc.has_security_group_logging(os_id): False [ 775.915539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.915539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.915539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.915539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.916081] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.916081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.916081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.916081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.916081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.916081] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c is going to be updated. [ 775.964536] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.968639] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.005906] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.006365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.006704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.007023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.007289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.025947] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: IN_PROGRESS for 2s [ 776.468592] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.468925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.468925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.469226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.469272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.469373] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 776.470798] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.470919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.470968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.472655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.472757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.472880] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 is going to be updated. [ 776.515909] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.516114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.516181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.516400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.516551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.520750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.520962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.520962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.521195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.521364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.534958] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: IN_PROGRESS for 2s [ 776.535769] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 776.625342] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 776.625581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.625751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.626067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.626197] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.626333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.626403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.626551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.626633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.626719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.626809] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.131339] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.131475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.131571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.131893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.132202] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.132317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.132387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.132641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.132789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.132933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.133176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.133281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.133352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.133534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.133691] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.133787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.133853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.133992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.134407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.134502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.134596] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.504399] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 777.504772] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=6 [ 777.636970] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80c55b4c-229d-4278-a249-6eb0843ce4fd: rpc.has_security_group_logging(os_id): False [ 777.661950] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.662303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.662373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.665364] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.665364] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.665364] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.665364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.666077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.666077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.666077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.666077] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 777.740512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.740817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.740817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.741153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.741299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.759383] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 778.045220] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: SUCCESS [ 778.045559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.547207] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 778.547482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.548259] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: SUCCESS [ 778.548452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.548613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.548834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.549043] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.549162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.549231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.549392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.549469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.549558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.549700] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.552625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.552625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.552625] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.552625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.552625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.552625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.552625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.552625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.552625] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.877192] env[65106]: INFO networking_nsxv3.common.synchronization [None req-e728788c-999c-4e51-a649-37760d4027a8 None None] Enqueued Resource ID: dc89549f-8ff2-49dd-b23c-fd9f6a093a01 with Priority: HIGHEST for action port [ 778.879374] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc89549f-8ff2-49dd-b23c-fd9f6a093a01 with Priority: HIGHEST for action port [ 778.879374] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc89549f-8ff2-49dd-b23c-fd9f6a093a01 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.879374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc89549f-8ff2-49dd-b23c-fd9f6a093a01" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.879374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc89549f-8ff2-49dd-b23c-fd9f6a093a01" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.879374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc89549f-8ff2-49dd-b23c-fd9f6a093a01" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.879374] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc89549f-8ff2-49dd-b23c-fd9f6a093a01',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.054236] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.055282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.055282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.055282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.055282] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.055282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.055282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.055282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.055713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.055713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.055713] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.055852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.055852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.055989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.056200] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.056627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.056627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.056627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.056627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.056942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.056942] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.058331] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.365913] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent loop - iteration:0 completed [ 779.365913] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent loop - iteration:1 started [ 779.381033] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc89549f-8ff2-49dd-b23c-fd9f6a093a01 [ 779.381330] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.381508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.381626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.381953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.382093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.382233] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc89549f-8ff2-49dd-b23c-fd9f6a093a01 already deleted. [ 779.382348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc89549f-8ff2-49dd-b23c-fd9f6a093a01" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.560523] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143c4b09-e4ef-4609-8ff0-863f1dce9402: rpc.has_security_group_logging(os_id): False [ 779.563321] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32: rpc.has_security_group_logging(os_id): False [ 779.586076] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.586363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.586446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.586671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.586750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.588067] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.588067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.588067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.588067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.588067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.588067] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.588067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.588067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.588412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.588412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.588612] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.588702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.588761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.588898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.588969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.589079] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 779.598029] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.598029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.598029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.598029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.598029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.598029] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.598029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.598029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.598029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.598029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.598029] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 is going to be created. [ 779.677123] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.677254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.678295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.678295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.678295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.687767] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.687767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.687767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.687767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.687767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.704191] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: IN_PROGRESS for 2s [ 779.714136] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 779.778555] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 779.778800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.236044] env[65106]: INFO networking_nsxv3.common.synchronization [None req-151fc682-0088-445d-900c-232e5724606e None None] Enqueued Resource ID: 0a188b42-f973-49af-8c0b-a61031de0a36 with Priority: HIGHEST for action port [ 781.236642] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a188b42-f973-49af-8c0b-a61031de0a36 with Priority: HIGHEST for action port [ 781.236642] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0a188b42-f973-49af-8c0b-a61031de0a36 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.236642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0a188b42-f973-49af-8c0b-a61031de0a36" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.237761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0a188b42-f973-49af-8c0b-a61031de0a36" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.238051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0a188b42-f973-49af-8c0b-a61031de0a36" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.238213] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0a188b42-f973-49af-8c0b-a61031de0a36',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.254101] env[65106]: INFO networking_nsxv3.common.synchronization [None req-e6a067ca-0042-4ab0-989a-42f1266d1963 None None] Enqueued Resource ID: 4b68064a-f915-4391-81a1-f1fefaa15987 with Priority: HIGHEST for action port [ 781.255789] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b68064a-f915-4391-81a1-f1fefaa15987 with Priority: HIGHEST for action port [ 781.255902] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b68064a-f915-4391-81a1-f1fefaa15987 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.257547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b68064a-f915-4391-81a1-f1fefaa15987" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.257547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b68064a-f915-4391-81a1-f1fefaa15987" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.257547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b68064a-f915-4391-81a1-f1fefaa15987" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.257547] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b68064a-f915-4391-81a1-f1fefaa15987',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.719328] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: SUCCESS [ 781.719602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.734077] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 781.735274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.742185] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0a188b42-f973-49af-8c0b-a61031de0a36 [ 781.744567] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.744822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.744938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.745652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.745652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.745652] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0a188b42-f973-49af-8c0b-a61031de0a36 already deleted. [ 781.745652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0a188b42-f973-49af-8c0b-a61031de0a36" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.760129] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b68064a-f915-4391-81a1-f1fefaa15987 [ 781.763307] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.763307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.763307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.763307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.763307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.763307] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b68064a-f915-4391-81a1-f1fefaa15987 already deleted. [ 781.763307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b68064a-f915-4391-81a1-f1fefaa15987" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.024916] env[65106]: INFO networking_nsxv3.common.synchronization [req-ae2a173b-e373-4690-a3d2-40a6ee28d555 req-0cd53f12-406a-40dc-9ac2-81df498575db tempest-ServersWithSpecificFlavorTestJSON-165470677 tempest-ServersWithSpecificFlavorTestJSON-165470677-project-member] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 782.028551] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 782.028551] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.028551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.028551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.028551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.028551] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.028551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.028551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.029889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.030295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.030586] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.534273] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.534579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.534579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.534784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.534784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.534981] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.535090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.535148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.536675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.536675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.536675] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 is going to be updated. [ 782.574297] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.575572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.575572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.575572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.575572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.586423] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-934 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.586664] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-934" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.586857] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-934" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.587470] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-934" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.587470] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.587758] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.587920] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.588251] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.588488] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.588751] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.588911] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.589122] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.589274] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.589495] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.589653] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.589923] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.591684] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: IN_PROGRESS for 2s [ 782.621155] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.621155] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.621155] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.621155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-934" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.621155] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-290bb5fb-6f3e-4da4-a41f-b179f85d233a taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.621155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-290bb5fb-6f3e-4da4-a41f-b179f85d233a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.621155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-290bb5fb-6f3e-4da4-a41f-b179f85d233a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.621155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-290bb5fb-6f3e-4da4-a41f-b179f85d233a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.621155] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('290bb5fb-6f3e-4da4-a41f-b179f85d233a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.125053] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.125053] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.142313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.142313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.142313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.142313] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 290bb5fb-6f3e-4da4-a41f-b179f85d233a not found, creating... [ 783.142313] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.142313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.142313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.142313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.142313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.142313] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.142922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.142922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.142922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.142922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.142922] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 290bb5fb-6f3e-4da4-a41f-b179f85d233a is going to be created. [ 783.160045] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.160257] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.160257] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.160564] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.160793] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.161045] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-290bb5fb-6f3e-4da4-a41f-b179f85d233a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.530281] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: d978f571-f3b1-47db-a4df-4215cfa258f5 with Priority: HIGHEST for action security_group_members [ 783.530506] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 783.530632] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 783.531316] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d978f571-f3b1-47db-a4df-4215cfa258f5 with Priority: HIGHEST for action security_group_members [ 783.531855] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 783.531984] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 783.532338] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d978f571-f3b1-47db-a4df-4215cfa258f5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.532472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.532536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.533090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.533090] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.533294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.533294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.533526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.533526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.533834] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.535479] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.537935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.537935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.537935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.537935] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.537935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.537935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.537935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.537935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.537935] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.537935] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.538802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.538802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.538802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.538802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.538802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.538802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.538802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.539088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.539088] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.592600] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 783.592600] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 783.592600] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_rules [ 783.592600] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 783.592600] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: d978f571-f3b1-47db-a4df-4215cfa258f5 with Priority: HIGHEST for action security_group_rules [ 783.592804] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: d978f571-f3b1-47db-a4df-4215cfa258f5 with Priority: HIGHEST for action security_group_members [ 783.594880] env[65106]: INFO networking_nsxv3.common.synchronization [req-27d1d8da-e3bb-4a98-8f46-649335af43cf req-99edf1f7-331b-4574-95d7-6cd9d0088c03 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 98b466ee-a460-4056-85d6-d93a61a587f2 with Priority: HIGHEST for action port [ 783.595549] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_rules [ 783.595724] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_rules [ 783.595794] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d978f571-f3b1-47db-a4df-4215cfa258f5 with Priority: HIGHEST for action security_group_members [ 783.595871] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98b466ee-a460-4056-85d6-d93a61a587f2 with Priority: HIGHEST for action port [ 783.595962] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d978f571-f3b1-47db-a4df-4215cfa258f5 with Priority: HIGHEST for action security_group_rules [ 783.596065] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 783.596148] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 783.596666] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.596796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.596859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.598365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.598463] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.599386] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.599544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.599610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.599757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.599855] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.600642] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d978f571-f3b1-47db-a4df-4215cfa258f5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.600737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.601219] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-98b466ee-a460-4056-85d6-d93a61a587f2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.601219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.601219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.601323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.601353] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98b466ee-a460-4056-85d6-d93a61a587f2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.607141] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d978f571-f3b1-47db-a4df-4215cfa258f5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.607141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.607141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.607141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.607141] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.608961] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.609176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.609522] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.609601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.953318] env[65106]: INFO networking_nsxv3.common.synchronization [req-ae2a173b-e373-4690-a3d2-40a6ee28d555 req-a1916c2e-dec5-4641-8c83-af3b1ee5ac4f service nova] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_rules [ 783.953563] env[65106]: INFO networking_nsxv3.common.synchronization [req-ae2a173b-e373-4690-a3d2-40a6ee28d555 req-a1916c2e-dec5-4641-8c83-af3b1ee5ac4f service nova] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 783.953735] env[65106]: INFO networking_nsxv3.common.synchronization [req-ae2a173b-e373-4690-a3d2-40a6ee28d555 req-a1916c2e-dec5-4641-8c83-af3b1ee5ac4f service nova] Enqueued Resource ID: 290bb5fb-6f3e-4da4-a41f-b179f85d233a with Priority: HIGHEST for action port [ 783.955049] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_rules [ 783.955258] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 783.955336] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 290bb5fb-6f3e-4da4-a41f-b179f85d233a with Priority: HIGHEST for action port [ 783.955730] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.955889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.955956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.956196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.956275] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.957796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.957923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.959012] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-290bb5fb-6f3e-4da4-a41f-b179f85d233a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.959128] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-290bb5fb-6f3e-4da4-a41f-b179f85d233a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.959206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-290bb5fb-6f3e-4da4-a41f-b179f85d233a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.959562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-290bb5fb-6f3e-4da4-a41f-b179f85d233a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.959654] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('290bb5fb-6f3e-4da4-a41f-b179f85d233a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.037268] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.042246] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.046853] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.106898] env[65106]: INFO networking_nsxv3.common.synchronization [None req-58bb1413-eef2-492e-98d5-7bda563fbf71 None None] Enqueued Resource ID: 813ed835-2fbe-46a7-9b8a-6db6f840902d with Priority: HIGHEST for action port [ 784.106898] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 813ed835-2fbe-46a7-9b8a-6db6f840902d with Priority: HIGHEST for action port [ 784.106898] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-813ed835-2fbe-46a7-9b8a-6db6f840902d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.106898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-813ed835-2fbe-46a7-9b8a-6db6f840902d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.106898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-813ed835-2fbe-46a7-9b8a-6db6f840902d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.106898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-813ed835-2fbe-46a7-9b8a-6db6f840902d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.106898] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('813ed835-2fbe-46a7-9b8a-6db6f840902d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.111163] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.111343] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.111655] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.112784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.113008] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98b466ee-a460-4056-85d6-d93a61a587f2 with status ACTIVE [ 784.113192] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.113300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.113368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.113644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.113676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.113845] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.113951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.114043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.114252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.114364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.116613] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.116613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.116613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.116613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.116613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.116613] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98b466ee-a460-4056-85d6-d93a61a587f2 is going to be updated. [ 784.123775] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d978f571-f3b1-47db-a4df-4215cfa258f5 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.123895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.143759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.143759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.143759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.143973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.144159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.144339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98b466ee-a460-4056-85d6-d93a61a587f2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.371298] env[65106]: INFO networking_nsxv3.common.synchronization [req-58b70a1a-576a-4207-9628-ffddce7406bc req-c200bf81-ecd0-4fd7-86cb-c9a951aeeeef tempest-ServersAdminTestJSON-1615839610 tempest-ServersAdminTestJSON-1615839610-project-member] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 784.372412] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 784.372765] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.372960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.373051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.373262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.374302] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.374434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.374501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.374696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.374785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.374886] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.458865] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.459038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.463125] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 290bb5fb-6f3e-4da4-a41f-b179f85d233a with status ACTIVE [ 784.463337] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.463465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.463532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.463745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.463841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.464019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.464127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.464188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.464340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.464401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.464583] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.464671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.464728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.464860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.464930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.465042] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 290bb5fb-6f3e-4da4-a41f-b179f85d233a is going to be updated. [ 784.488059] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.488059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.488059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.488059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.488059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.488506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-290bb5fb-6f3e-4da4-a41f-b179f85d233a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.550295] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.551288] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.552330] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.604874] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: SUCCESS [ 784.605108] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 deletion is rescheduled due to dependency. [ 784.605269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.605452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.605668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.605885] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.605986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.606062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.606798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.606798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.606798] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.607358] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 813ed835-2fbe-46a7-9b8a-6db6f840902d [ 784.607586] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.607703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.607768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.607926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.608012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.608111] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:813ed835-2fbe-46a7-9b8a-6db6f840902d already deleted. [ 784.608190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-813ed835-2fbe-46a7-9b8a-6db6f840902d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.877667] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.055036] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.055036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.055036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.055280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.055368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.055565] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 785.057160] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.057291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.057675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.057783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.057961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.058128] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d978f571-f3b1-47db-a4df-4215cfa258f5 is going to be created. [ 785.059501] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.059672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.059772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.059951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.060049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.060141] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 is going to be updated. [ 785.096772] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.096772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.096772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.097178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.097178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.099878] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.100016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.100090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.100290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.100426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.102594] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.102724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.102864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.103104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.103246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.110132] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.112589] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 785.113196] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d978f571-f3b1-47db-a4df-4215cfa258f5 in Status: UNINITIALIZED for 2s [ 785.114192] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: IN_PROGRESS for 2s [ 785.380528] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.612981] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.884144] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.884327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.884503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.884729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.884828] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.884928] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 785.918119] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.918288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.918369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.918683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.918792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.933204] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 786.116595] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.116842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.116919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.117272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.117429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.117557] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 is going to be updated. [ 786.157667] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.157667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.157667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.157951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.158453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.169756] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: IN_PROGRESS for 2s [ 787.130264] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: SUCCESS [ 787.130626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.130934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.131271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.131526] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.131705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.131843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.132285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.132285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.132416] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.134521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 787.134521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.135587] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d978f571-f3b1-47db-a4df-4215cfa258f5 in Status: SUCCESS [ 787.135789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.136022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.137261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.137261] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.137261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.137261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.137261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.137261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.137261] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.138029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.138217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.138391] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.138559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.138559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.138690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.138927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.138927] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.641675] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.642805] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.645567] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.944917] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 787.945196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.145151] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.146873] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.148665] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.185147] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: SUCCESS [ 788.185425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.185706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.186058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.186352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.186528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.186605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.186787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.186881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.186957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.187076] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.313027] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.313027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.313027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.313027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.313027] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.650164] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.650320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.650390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.650629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.650712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.650840] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 is going to be updated. [ 788.653285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.653484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.653569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.654060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.654191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.654292] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d978f571-f3b1-47db-a4df-4215cfa258f5 is going to be updated. [ 788.656601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.657294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.657294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.657294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.657294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.657294] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 788.691867] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.698122] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.698303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.698834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.698957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.699355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.701862] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.702228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.702228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.702421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.702458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.704926] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.704926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.704926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.704926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.704926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.719862] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d978f571-f3b1-47db-a4df-4215cfa258f5 in Status: IN_PROGRESS for 2s [ 788.723579] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: IN_PROGRESS for 2s [ 788.724814] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 788.816455] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.193373] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4202ae94-9151-4db6-b1be-f69fcc7dc349: rpc.has_security_group_logging(os_id): False [ 789.222278] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.222518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.222518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.222709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.222800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.223107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.223213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.223275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.223432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.223523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.223608] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 is going to be updated. [ 789.320201] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.323614] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.323614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.323614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.323766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.324843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.342319] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: IN_PROGRESS for 2s [ 789.373650] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 789.373848] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=7 [ 789.386013] env[65106]: INFO networking_nsxv3.common.synchronization [req-379dbc30-9e46-491d-b1e6-c22375b35f55 req-b74e81e8-d5cd-4890-8aac-77e90f60ea5b tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 789.386175] env[65106]: INFO networking_nsxv3.common.synchronization [req-379dbc30-9e46-491d-b1e6-c22375b35f55 req-b74e81e8-d5cd-4890-8aac-77e90f60ea5b tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 789.386303] env[65106]: INFO networking_nsxv3.common.synchronization [req-379dbc30-9e46-491d-b1e6-c22375b35f55 req-b74e81e8-d5cd-4890-8aac-77e90f60ea5b tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: d978f571-f3b1-47db-a4df-4215cfa258f5 with Priority: HIGHEST for action security_group_members [ 789.386857] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 789.386987] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGHEST for action security_group_members [ 789.387119] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d978f571-f3b1-47db-a4df-4215cfa258f5 with Priority: HIGHEST for action security_group_members [ 789.387356] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.387462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.388118] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.388211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.388394] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d978f571-f3b1-47db-a4df-4215cfa258f5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.388475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.801932] env[65106]: INFO networking_nsxv3.common.synchronization [req-2288c543-93df-40dc-9deb-0c3d32539fe7 req-99143400-2a2e-415d-b3ca-6f1b3745f215 tempest-ServersAdminNegativeTestJSON-1593145529 tempest-ServersAdminNegativeTestJSON-1593145529-project-member] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 789.802612] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGHEST for action security_group_members [ 789.803353] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.803458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.803564] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.803901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.804228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.804389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.804478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.804866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.804866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.806397] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.824369] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 789.824369] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 790.221217] env[65106]: INFO networking_nsxv3.common.synchronization [req-60dc3c85-6b51-45fa-ac72-488237c1f87b req-52442bc5-5fe8-44ea-b9e3-15e410331639 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 790.221854] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 790.222121] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.222242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.222305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.222598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.222762] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.222863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.222931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.223236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.223344] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.223536] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.310368] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.311546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.311546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.311546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.311546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.311546] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.311546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.311546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.311955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.311955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.311955] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5872a413-0244-4425-a9f8-dd282f886327 is going to be updated. [ 790.354539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.354539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.354539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.354539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.354539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.375407] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: IN_PROGRESS for 2s [ 790.726985] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.727212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.727270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.727489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.727663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.727797] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.727916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.727987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.728671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.728757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.728849] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 already deleted. [ 790.729083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.750948] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.751236] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.751379] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.751923] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.752223] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.752398] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.752508] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.752736] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.752869] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.753211] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.753320] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 790.753421] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 790.753521] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 790.753625] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 790.753712] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 790.753853] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 790.757849] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d978f571-f3b1-47db-a4df-4215cfa258f5 in Status: SUCCESS [ 790.758062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.758488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.758679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.758852] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.758955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.759033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.759197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.759262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.759345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.759446] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.762378] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: SUCCESS [ 790.762566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.764818] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 790.765326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.765640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.765937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.766135] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.766246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.767124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.767322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.767424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.767570] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.768615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.768782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.768942] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.769080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.769130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.769291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.769328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.770223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.770223] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.770223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.770326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.770435] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.770542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.770591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.770727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.770801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.771021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.771119] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.774342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.774511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.774706] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.774758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.774826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.774965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.775057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.775158] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.775784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.775942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.776132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.776234] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.776298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.776434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.776508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.776590] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.797395] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 790.797597] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.044 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 790.797787] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 790.797990] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.798231] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.798401] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.798518] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.799370] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.799370] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.853433] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.853575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.853647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.853861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.868895] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 790.869985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.871778] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 790.899468] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.899628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.899628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.899918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.905608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.906160] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 790.906237] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 790.906322] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 790.942795] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.943089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.943089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.943276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.945160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.945160] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 791.015475] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.015475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.015475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.015765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.015852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.016131] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 791.095013] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.095206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.095306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.095484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.095727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.096354] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:34. [ 791.096477] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f5e826db-704a-4f90-8b10-2d48839251d7', '0c4b9f28-129e-4614-b2d6-9173d8122416', 'de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e', 'cb38d759-8a21-4a9b-a191-18a3de159f87', 'b6947545-c4e6-4692-9dfa-c1bdd403650c', '81a7c51f-690b-43e1-a214-2196c4632ae4', '032e481c-c000-4759-9f25-bd2a5ca64cb7', 'cb69e9e4-2eab-4e65-ad5f-9c7914f93491', '5872a413-0244-4425-a9f8-dd282f886327', 'b4755538-f7a6-45f7-9a19-37103260244a', 'cbe5502d-c241-4f70-a5e4-91617fb44bf1', '108c3320-1bbb-4cb7-a30a-c66ddca2d037', '52a63c62-ab68-4afc-b239-81d4bb46173e', '63b6ebcd-ce8d-4da7-b33a-c7bd45edb898', '6d3d6dc0-48cf-4703-a02e-4166d71fd73a', '416df7e5-52a8-484d-a488-4f4f2380f0a6', '00fc8ecc-2b12-478d-8a50-43a7183605bc', '80c55b4c-229d-4278-a249-6eb0843ce4fd', '7d1b20bd-0df3-43fe-8d0c-3fba6e609d32', '5b77c3b5-bcbc-4373-ba6a-5877c470d364', '1c844632-55aa-48db-8ca5-f00fe2244035', 'ac9de4d4-ec9d-4ad4-ad6f-65eee9862501', '5e524fc2-f045-49dd-9b9d-694845e21af8', '8062a050-fddc-4392-b032-558be3ae0629', 'f58b21a0-a1cb-4daa-9136-8c66dc9641d3', '49f44a93-5686-4d9d-984b-4efb2550596c', 'f8e3138f-71fe-44de-b062-382436a9dc63', 'c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9', '4dcae410-a891-453e-bd43-6b1770f373d3', 'ff5ba0af-d21f-4f03-b95d-0c41f57292b6', '19332543-7a24-4c8f-8b80-055c71f06f3d', '143c4b09-e4ef-4609-8ff0-863f1dce9402', '4202ae94-9151-4db6-b1be-f69fcc7dc349', '801f4d67-386f-4801-8f6a-7817c5da92ef'} {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.096577] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 791.117771] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.118195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.118375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.118621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.118715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.118851] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 791.118925] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.118997] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 791.198748] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.198920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.198994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.199229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.200410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.200410] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 791.200410] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 791.200410] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 791.200410] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 791.200645] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/34 resources of Type:Security Group Rules [ 791.200645] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGH for action security_group_rules [ 791.200645] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGH for action security_group_rules [ 791.200735] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGH for action security_group_rules [ 791.200735] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGH for action security_group_rules [ 791.200828] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGH for action security_group_rules [ 791.200828] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGH for action security_group_rules [ 791.200909] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGH for action security_group_rules [ 791.200998] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGH for action security_group_rules [ 791.201059] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGH for action security_group_rules [ 791.201106] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGH for action security_group_rules [ 791.201171] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGH for action security_group_rules [ 791.201476] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGH for action security_group_rules [ 791.201476] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGH for action security_group_rules [ 791.201476] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGH for action security_group_rules [ 791.201476] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGH for action security_group_rules [ 791.201476] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGH for action security_group_rules [ 791.201758] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGH for action security_group_rules [ 791.201758] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGH for action security_group_rules [ 791.201758] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGH for action security_group_rules [ 791.201758] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGH for action security_group_rules [ 791.202270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.262888] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d978f571-f3b1-47db-a4df-4215cfa258f5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.273018] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.273231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.273340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.273560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.273649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.273918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.274077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.274170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.274321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.274399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.274489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d978f571-f3b1-47db-a4df-4215cfa258f5 is going to be deleted. [ 791.275642] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.279175] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.279323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.279578] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.279689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.279751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.280226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.281202] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.302625] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.302889] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.303113] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.303668] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.303668] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.303844] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba not found, creating... [ 791.303979] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.304166] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.304274] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.304512] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.304647] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.304941] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.305129] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.305230] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.305581] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.305723] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.305860] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba is going to be created. [ 791.310891] env[65106]: INFO networking_nsxv3.common.synchronization [req-b3898155-4cfe-4d14-9969-32757c6a0c12 req-92cb8298-285a-4992-87d4-abb6ff1e5bce tempest-AttachInterfacesV270Test-1052302337 tempest-AttachInterfacesV270Test-1052302337-project-member] Enqueued Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGHEST for action security_group_members [ 791.311520] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGHEST for action security_group_members [ 791.311683] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGH for action security_group_rules [ 791.311789] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e with Priority: HIGH for action security_group_rules [ 791.311888] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 with Priority: HIGH for action security_group_rules [ 791.311984] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGH for action security_group_rules [ 791.312189] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGH for action security_group_rules [ 791.312297] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 with Priority: HIGH for action security_group_rules [ 791.312390] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGH for action security_group_rules [ 791.312491] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGH for action security_group_rules [ 791.312583] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGH for action security_group_rules [ 791.312671] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 with Priority: HIGH for action security_group_rules [ 791.312777] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGH for action security_group_rules [ 791.312861] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGH for action security_group_rules [ 791.313022] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGH for action security_group_rules [ 791.313439] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGH for action security_group_rules [ 791.313546] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5872a413-0244-4425-a9f8-dd282f886327 with Priority: HIGH for action security_group_rules [ 791.313636] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 with Priority: HIGH for action security_group_rules [ 791.313750] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGH for action security_group_rules [ 791.313835] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6947545-c4e6-4692-9dfa-c1bdd403650c with Priority: HIGH for action security_group_rules [ 791.313923] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGH for action security_group_rules [ 791.314069] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb38d759-8a21-4a9b-a191-18a3de159f87 with Priority: HIGH for action security_group_rules [ 791.314392] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.314529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.314595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.314820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.314985] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.315103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.315175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.315386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.315469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.315569] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.316528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.316630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.316686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.316846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.316940] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.317745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.317873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.317935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.318067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.318148] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.318913] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032e481c-c000-4759-9f25-bd2a5ca64cb7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.319024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.319089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.319264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.319346] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032e481c-c000-4759-9f25-bd2a5ca64cb7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.320225] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.320334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.320424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.320615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.320778] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.321973] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.322135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.322197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.322329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.322401] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.323836] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.323836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.323836] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.324048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.324106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.324270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.324349] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.325507] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.325887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.325887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.325887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.326319] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.326319] env[65106]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 791.327511] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.327511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.327642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.327742] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.327813] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.329925] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-416df7e5-52a8-484d-a488-4f4f2380f0a6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.329925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.329925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.329925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.329925] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('416df7e5-52a8-484d-a488-4f4f2380f0a6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.330305] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.330414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.330481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.330638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.330710] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.334552] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.334552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.334552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.334752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.334870] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.336227] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.336412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.336522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.336726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.336792] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.338429] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.338575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.338637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.338832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.338907] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.340265] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5872a413-0244-4425-a9f8-dd282f886327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.340399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.340468] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.340664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.340741] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5872a413-0244-4425-a9f8-dd282f886327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.342243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-81a7c51f-690b-43e1-a214-2196c4632ae4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.342243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.342243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.342502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.342502] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('81a7c51f-690b-43e1-a214-2196c4632ae4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.343507] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.343610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.343723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.343849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.343927] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.345339] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6947545-c4e6-4692-9dfa-c1bdd403650c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.345509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.345581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.345776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.345885] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6947545-c4e6-4692-9dfa-c1bdd403650c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.346200] env[65106]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 791.347106] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.347212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.347282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.347443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.347515] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.348650] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb38d759-8a21-4a9b-a191-18a3de159f87 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.348819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.348819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.349013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.349098] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb38d759-8a21-4a9b-a191-18a3de159f87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.355117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.355366] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.355503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.355584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.355736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.355825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.355883] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 is going to be updated. [ 791.359387] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.359762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.359762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.359999] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.360279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.360506] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.402151] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: SUCCESS [ 791.402492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.410737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.410927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.411036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.411302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.411503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.442535] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: IN_PROGRESS for 2s [ 791.474301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.474301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.474301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.474601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.474601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.474601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.766065] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d978f571-f3b1-47db-a4df-4215cfa258f5: rpc.has_security_group_logging(os_id): False [ 791.778730] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32: rpc.has_security_group_logging(os_id): False [ 791.783642] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.796158] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.796322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.796406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.796700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.798226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.798632] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.798840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.798991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.799307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.799480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.799885] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d978f571-f3b1-47db-a4df-4215cfa258f5 is going to be created. [ 791.805372] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.805372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.805372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.805627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.805763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.806415] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.806601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.806712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.806948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.807088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.807244] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 is going to be updated. [ 791.833695] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d978f571-f3b1-47db-a4df-4215cfa258f5], does not exist path=[/infra/domains/default/groups/d978f571-f3b1-47db-a4df-4215cfa258f5]."\n}' [ 791.833961] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d978f571-f3b1-47db-a4df-4215cfa258f5 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d978f571-f3b1-47db-a4df-4215cfa258f5 [ 791.834090] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 791.861036] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.861397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.861540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.861893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.862596] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.862821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.863063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.863458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.864159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.864365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.864539] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.866325] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.866558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.867164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.867470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.877190] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.877321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.880019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.880019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.887414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.887621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.889849] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.889997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.898617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.898902] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.899047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.899109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.899347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.899427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.899518] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e is going to be updated. [ 791.901379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.901562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.904309] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.904463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.904531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.904710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.905107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.905216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.905278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.905443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.905519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.905636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.905792] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.908468] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.908608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.908668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.908875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.909065] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.909163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.909224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.909400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.909462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.909558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.909686] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.913268] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.913412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.913467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.913678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.915035] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.915711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.915711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.915711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.915711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.915711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.915711] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.921204] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.921405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.921510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.922478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.922478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.922478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.922478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.922691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.922691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.922999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.922999] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.924331] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.924508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.924583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.929096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.929096] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.929096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.929096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.929096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.929096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.929096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.929096] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.933835] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.934030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.934109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.934301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.934462] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.934553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.934612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.934753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.934829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.934910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.934995] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.936335] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.936441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.939703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.939703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.939703] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.939703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.939703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.939703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.939703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.939703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.939703] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.940104] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.940104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.940104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.940321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.940449] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.940562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.940622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.940769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.940852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.940949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.941044] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.943384] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.943505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.943601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.943739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.943943] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.944048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.944111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.944317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.944359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.944442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.944506] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.956083] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.959227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.959352] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032e481c-c000-4759-9f25-bd2a5ca64cb7 is going to be deleted. [ 791.962048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.962330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.962373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.962770] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e is going to be deleted. [ 791.964802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.964935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.965012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.965212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.965339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.971570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.972277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.972631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.973040] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.973311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.973311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.973439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.973439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.973620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.973703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.973765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.973906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.973982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.974079] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d978f571-f3b1-47db-a4df-4215cfa258f5 is going to be created. [ 791.980649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.980886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.980998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.991362] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.991502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.991559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.992707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.994470] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.994544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.997829] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.997977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.998814] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.998915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.000764] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.000764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.000928] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.000928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.008877] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e in Status: IN_PROGRESS for 2s [ 792.023272] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.023470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.025522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.025650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be deleted. [ 792.026801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.027820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.035957] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: IN_PROGRESS for 2s [ 792.054700] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/d978f571-f3b1-47db-a4df-4215cfa258f5], does not exist path=[/infra/domains/default/groups/d978f571-f3b1-47db-a4df-4215cfa258f5]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d978f571-f3b1-47db-a4df-4215cfa258f5 [ 792.054700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d978f571-f3b1-47db-a4df-4215cfa258f5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.055106] env[65106]: Traceback (most recent call last): [ 792.055167] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 792.055167] env[65106]: return func(*args, **kwargs) [ 792.055167] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 792.055167] env[65106]: res.raise_for_status() [ 792.055167] env[65106]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 792.055167] env[65106]: raise HTTPError(http_error_msg, response=self) [ 792.055167] env[65106]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d978f571-f3b1-47db-a4df-4215cfa258f5 [ 792.055167] env[65106]: During handling of the above exception, another exception occurred: [ 792.055167] env[65106]: Traceback (most recent call last): [ 792.055167] env[65106]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 792.055167] env[65106]: listener.cb(fileno) [ 792.055167] env[65106]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 792.055167] env[65106]: result = function(*args, **kwargs) [ 792.055167] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 792.055167] env[65106]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 792.055627] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 792.055627] env[65106]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 792.055627] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 792.055627] env[65106]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 792.055627] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 792.055627] env[65106]: res.raise_for_status() [ 792.055627] env[65106]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 792.055627] env[65106]: raise HTTPError(http_error_msg, response=self) [ 792.055627] env[65106]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/d978f571-f3b1-47db-a4df-4215cfa258f5 [ 792.055627] env[65106]: Removing descriptor: 66 [ 792.061133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.061285] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5872a413-0244-4425-a9f8-dd282f886327 is going to be deleted. [ 792.062945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.062945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.100442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.100836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.106790] env[65106]: INFO networking_nsxv3.common.synchronization [req-60dc3c85-6b51-45fa-ac72-488237c1f87b req-3a682658-ce21-4aac-bc88-dcb15dc45010 service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 792.109042] env[65106]: INFO networking_nsxv3.common.synchronization [req-60dc3c85-6b51-45fa-ac72-488237c1f87b req-3a682658-ce21-4aac-bc88-dcb15dc45010 service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 792.109042] env[65106]: INFO networking_nsxv3.common.synchronization [req-60dc3c85-6b51-45fa-ac72-488237c1f87b req-3a682658-ce21-4aac-bc88-dcb15dc45010 service nova] Enqueued Resource ID: 1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba with Priority: HIGHEST for action port [ 792.109042] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.109042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.109383] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 792.109594] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 792.109721] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba with Priority: HIGHEST for action port [ 792.110148] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.110374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.110434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.110777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.110907] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.112224] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.113390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.113525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.113673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.114029] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.114138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.114221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.114394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.114476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.114585] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.119034] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.119034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.119034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.119034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.119034] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.119034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.119034] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb38d759-8a21-4a9b-a191-18a3de159f87 is going to be deleted. [ 792.119709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.119709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.162771] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.162771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.177032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.177032] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 416df7e5-52a8-484d-a488-4f4f2380f0a6 is going to be deleted. [ 792.177032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.177032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.201776] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.201997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.232128] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.232346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.240271] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 792.240876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.241105] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be deleted. [ 792.242118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.242385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.287692] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.288126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.288126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.288353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.288353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.288498] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 792.317704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.317962] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 81a7c51f-690b-43e1-a214-2196c4632ae4 is going to be deleted. [ 792.319458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.319612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.370842] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.400273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.400691] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6947545-c4e6-4692-9dfa-c1bdd403650c is going to be deleted. [ 792.401926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.402279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.402386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.402513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.402791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.403027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.403135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.403254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032e481c-c000-4759-9f25-bd2a5ca64cb7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.403848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.404151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.404244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.404365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.404512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.404667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.404747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.404871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.405764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.405764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.405764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.405764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb38d759-8a21-4a9b-a191-18a3de159f87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.414500] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.418321] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.418321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.418321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.418321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.418321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.418321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-416df7e5-52a8-484d-a488-4f4f2380f0a6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.424795] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5872a413-0244-4425-a9f8-dd282f886327 in Status: SUCCESS [ 792.424795] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5872a413-0244-4425-a9f8-dd282f886327 deletion is rescheduled due to dependency. [ 792.424795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5872a413-0244-4425-a9f8-dd282f886327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.431054] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.431198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.431266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.431485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.431632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.432847] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.432994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.433150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.433354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.433514] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.433613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.433675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.433891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.434026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.434183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.434245] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.434320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.434376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.434514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.434647] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.434735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.434797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.434930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.435093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.435093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.435192] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.438472] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.438547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.438585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.439512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.439512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.439512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.448901] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.453019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.453019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.453019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.453019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.453019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.453685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.453799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.453831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.453890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.453976] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.457571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.457571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.457571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.457571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.457571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.457571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.457571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.457571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.457571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.457571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.457571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.458038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.458038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.458038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.458132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.458176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.458296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.458354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.458427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.458502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.458629] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.459625] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.459816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.459816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.459877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.460060] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.460181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.460279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.460470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.460556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.460636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.460783] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.460875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.460995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.461090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.462529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.462529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.462529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.462529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.462737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.462737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.462792] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.465869] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.474634] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.474634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.474634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.474634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.474823] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.474823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.474898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.475181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.475181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.475181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.475339] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.475416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.475470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.475613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.475745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.475832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.475887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.476025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.476096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.476172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.476256] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.477205] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4755538-f7a6-45f7-9a19-37103260244a: rpc.has_security_group_logging(os_id): False [ 792.483418] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 792.520327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.520327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.520327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.520327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.551191] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.551191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.567888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.568248] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.568410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.568485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.568710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.568796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.568896] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 792.570159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.570430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.570539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.570660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-81a7c51f-690b-43e1-a214-2196c4632ae4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.610236] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.610236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.610236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.610236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.610236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.610236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6947545-c4e6-4692-9dfa-c1bdd403650c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.620504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.620504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.620764] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.622843] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba with status ACTIVE [ 792.622843] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.622843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.622843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.622843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.622843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.622843] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.622843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.622843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.622843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.623496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.623496] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.623496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.623496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.623704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.623704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.623768] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba is going to be updated. [ 792.695258] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.697124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.697124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.697124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.697124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.697124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1949d12d-e2a3-4fc3-9a0e-16d6c6a8ebba" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.795455] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 792.796234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.797786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.797786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.797786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.797786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.868805] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 792.875608] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f5e826db-704a-4f90-8b10-2d48839251d7: rpc.has_security_group_logging(os_id): False [ 792.915591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.915591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.915591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.915591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.916862] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb69e9e4-2eab-4e65-ad5f-9c7914f93491: rpc.has_security_group_logging(os_id): False [ 792.939769] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00fc8ecc-2b12-478d-8a50-43a7183605bc: rpc.has_security_group_logging(os_id): False [ 792.954021] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898: rpc.has_security_group_logging(os_id): False [ 792.959753] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.959909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.960153] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 108c3320-1bbb-4cb7-a30a-c66ddca2d037: rpc.has_security_group_logging(os_id): False [ 792.971995] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5b77c3b5-bcbc-4373-ba6a-5877c470d364: rpc.has_security_group_logging(os_id): False [ 792.973577] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbe5502d-c241-4f70-a5e4-91617fb44bf1: rpc.has_security_group_logging(os_id): False [ 792.980707] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.980707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.980707] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6d3d6dc0-48cf-4703-a02e-4166d71fd73a: rpc.has_security_group_logging(os_id): False [ 792.982422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.982714] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.983489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.983489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.983489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.983489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.983489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 is going to be updated. [ 792.985727] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.985727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.985727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.985927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.989406] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80c55b4c-229d-4278-a249-6eb0843ce4fd: rpc.has_security_group_logging(os_id): False [ 792.989406] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.989406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.011229] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.011229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.014857] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.014857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.014857] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.014857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.014857] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.014857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.023437] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.023437] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.023437] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.023437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.024112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.024332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.024546] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 793.026170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.026478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.048254] env[65106]: INFO networking_nsxv3.common.synchronization [req-3f5190bd-645b-4ed4-a16a-fa72a5e4b7c5 req-d6bbe527-3f28-473b-ae94-759e19a20a1d tempest-ServerExternalEventsTest-376125758 tempest-ServerExternalEventsTest-376125758-project-member] Enqueued Resource ID: 339605f7-09cd-456f-a3a0-4495fb59f075 with Priority: HIGHEST for action security_group_members [ 793.050359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.051301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.051647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.051874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.052458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.052671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.052873] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be updated. [ 793.056281] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339605f7-09cd-456f-a3a0-4495fb59f075 with Priority: HIGHEST for action security_group_members [ 793.056794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.057200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.061695] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-339605f7-09cd-456f-a3a0-4495fb59f075 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.061695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.061695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.061695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.061695] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.061695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.061695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.061695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.061695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.061695] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('339605f7-09cd-456f-a3a0-4495fb59f075',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.082823] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.082823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.084355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.085025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.085338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.087019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.087019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.087019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.087019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.087019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.087019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.087019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.087019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.087019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.087611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.087889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.088187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.088423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.088627] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be updated. [ 793.090974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.092627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.111274] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.111274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.126431] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.135457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.135959] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.135959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.136139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.139115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.139115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.139115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.139115] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 793.139760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.139760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.151659] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.151847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.169228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.170320] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.170320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.170320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.170320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.170320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.170644] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.170730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.170730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.171060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.171154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.171338] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.171443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.171485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.172629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.172629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.172629] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be updated. [ 793.172900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.173183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.203594] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.203812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.248920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.250051] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.250051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.250051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.250322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.250322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.250322] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 is going to be updated. [ 793.251951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.252208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.300197] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.300502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.350024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.350740] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.350969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.350969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.351209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.351297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.351549] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.351729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.351766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.351933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.352051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.353967] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.354183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.354751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.355056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.355224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.355410] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 is going to be updated. [ 793.356593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.356825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.405949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.406333] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.406457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.406509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.406804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.406906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.406957] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 is going to be updated. [ 793.408554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.408764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.409018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.410414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.410628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.410785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.411788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.411994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.412151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.413306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.413306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.413446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.415271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.415271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.415271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.455382] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.455593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.455593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.455804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.455952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.462144] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f5e826db-704a-4f90-8b10-2d48839251d7 in Status: SUCCESS [ 793.462144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.462793] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: IN_PROGRESS for 2s [ 793.471284] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.473698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.473698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.473698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.473698] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.473698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.473698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.473698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.473698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.473698] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.473698] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 793.473698] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 793.473698] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 793.473698] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 793.474156] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 793.474156] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 793.475830] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: SUCCESS [ 793.476010] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 deletion is rescheduled due to dependency. [ 793.476127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.478379] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 793.484385] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 793.486255] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: IN_PROGRESS for 2s [ 793.488385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.488550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.488631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.488924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.489113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.490806] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: IN_PROGRESS for 2s [ 793.529680] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 in Status: IN_PROGRESS for 2s [ 793.530650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 793.530816] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 793.530966] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 793.531163] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-785" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.531478] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-61962cbf-a204-4999-8f33-d22fa9356972 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.531652] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-61962cbf-a204-4999-8f33-d22fa9356972" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.531770] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-61962cbf-a204-4999-8f33-d22fa9356972" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.532129] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-61962cbf-a204-4999-8f33-d22fa9356972" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.532281] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61962cbf-a204-4999-8f33-d22fa9356972',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.563943] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.564196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.564287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.564485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.564570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.564913] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.564913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.565156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.565156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.566924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.566924] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 339605f7-09cd-456f-a3a0-4495fb59f075 already deleted. [ 793.566924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.578818] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.579082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.579082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.579360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.579571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.602737] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 in Status: IN_PROGRESS for 2s [ 793.616823] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.616957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.617052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.617240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.617619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.635200] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.635200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.635200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.635200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.635200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.635200] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be created. [ 793.651053] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: IN_PROGRESS for 2s [ 793.687039] env[65106]: INFO networking_nsxv3.common.synchronization [req-bd4578b9-622a-45ed-9db8-4f14ecbb4677 req-a70f40ad-3429-4297-9c90-cd9b7d8122ef tempest-InstanceActionsTestJSON-2090033735 tempest-InstanceActionsTestJSON-2090033735-project-member] Enqueued Resource ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 with Priority: HIGHEST for action security_group_members [ 793.687798] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 with Priority: HIGHEST for action security_group_members [ 793.688231] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.688419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.688527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.688775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.688994] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.689150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.689240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.689438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.689561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.689708] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ff5ba0af-d21f-4f03-b95d-0c41f57292b6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.705465] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.705613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.705669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.705879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.706051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.727329] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: UNINITIALIZED for 2s [ 794.019315] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e in Status: SUCCESS [ 794.019470] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e deletion is rescheduled due to dependency. [ 794.019543] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-de2ddf5e-91af-4fc0-ab7b-9e90d2d3dc0e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.036934] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.037286] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.037474] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.037832] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.038650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.038650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 61962cbf-a204-4999-8f33-d22fa9356972 not found, creating... [ 794.039380] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.039791] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.039938] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.040761] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.041101] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.041460] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.042225] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.042349] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.042622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.042761] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.043211] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 61962cbf-a204-4999-8f33-d22fa9356972 is going to be created. [ 794.060720] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 in Status: SUCCESS [ 794.061055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.061186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.061613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.061667] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d1b20bd-0df3-43fe-8d0c-3fba6e609d32',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.069637] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.069930] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.070109] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.070659] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.071056] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.071593] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-61962cbf-a204-4999-8f33-d22fa9356972" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.192385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.192553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.192625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.192861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.224535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.224815] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.224932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.224998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.225275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.225409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.225460] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 is going to be updated. [ 794.259223] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.259447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.259447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.259645] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.259803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.275686] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 in Status: IN_PROGRESS for 2s [ 794.494879] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 794.495360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.495360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.495360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.495580] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.495667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.495713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.495860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.496025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.496141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.496289] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.496380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.496442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.496578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.496719] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.496807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.496867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.497013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.497095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.497151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.497225] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.585498] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.585694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.585694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.586977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.586977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.586977] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d1b20bd-0df3-43fe-8d0c-3fba6e609d32 is going to be deleted. [ 794.645085] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.645325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.645616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.645863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.646052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.646290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d1b20bd-0df3-43fe-8d0c-3fba6e609d32" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.796185] env[65106]: INFO networking_nsxv3.common.synchronization [req-3f5190bd-645b-4ed4-a16a-fa72a5e4b7c5 req-e8471430-dd7d-4be8-9739-3d28090bda9e service nova] Enqueued Resource ID: 339605f7-09cd-456f-a3a0-4495fb59f075 with Priority: HIGHEST for action security_group_rules [ 794.796185] env[65106]: INFO networking_nsxv3.common.synchronization [req-3f5190bd-645b-4ed4-a16a-fa72a5e4b7c5 req-e8471430-dd7d-4be8-9739-3d28090bda9e service nova] Enqueued Resource ID: 339605f7-09cd-456f-a3a0-4495fb59f075 with Priority: HIGHEST for action security_group_members [ 794.796185] env[65106]: INFO networking_nsxv3.common.synchronization [req-3f5190bd-645b-4ed4-a16a-fa72a5e4b7c5 req-e8471430-dd7d-4be8-9739-3d28090bda9e service nova] Enqueued Resource ID: 61962cbf-a204-4999-8f33-d22fa9356972 with Priority: HIGHEST for action port [ 794.796185] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339605f7-09cd-456f-a3a0-4495fb59f075 with Priority: HIGHEST for action security_group_rules [ 794.796185] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339605f7-09cd-456f-a3a0-4495fb59f075 with Priority: HIGHEST for action security_group_members [ 794.796185] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61962cbf-a204-4999-8f33-d22fa9356972 with Priority: HIGHEST for action port [ 794.796185] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-339605f7-09cd-456f-a3a0-4495fb59f075 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.796185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.796185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.798507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.798796] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('339605f7-09cd-456f-a3a0-4495fb59f075',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.801327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-339605f7-09cd-456f-a3a0-4495fb59f075 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.801565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.801864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.802326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.802648] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.802904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.803094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.803372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.803630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.804014] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('339605f7-09cd-456f-a3a0-4495fb59f075',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.808498] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-61962cbf-a204-4999-8f33-d22fa9356972 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.808498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61962cbf-a204-4999-8f33-d22fa9356972" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.808498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61962cbf-a204-4999-8f33-d22fa9356972" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.808498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61962cbf-a204-4999-8f33-d22fa9356972" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.808498] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61962cbf-a204-4999-8f33-d22fa9356972',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.885398] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 794.885532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.999428] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 143c4b09-e4ef-4609-8ff0-863f1dce9402: rpc.has_security_group_logging(os_id): False [ 795.024474] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.024625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.024721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.024997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.048502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.048777] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.048898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.048959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.049223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.049314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.049515] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.049618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.049682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.049830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.049904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.050973] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.050973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.050973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.050973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.050973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.050973] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 795.121306] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.121508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.121575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.121891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.122148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.139762] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 795.195063] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3661896-6467-48e6-b679-8b0385a30e15 req-9fd8fd59-bc09-4a05-b25a-e67f2c024ef2 tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 795.195876] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 795.196694] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.196880] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.197091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.197390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.197704] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.197855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.197949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.198198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.198330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.198480] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.308330] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('339605f7-09cd-456f-a3a0-4495fb59f075',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.310477] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-339605f7-09cd-456f-a3a0-4495fb59f075 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.310477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.310596] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 61962cbf-a204-4999-8f33-d22fa9356972 with status ACTIVE [ 795.310806] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.310895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.310982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.311181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.311392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.311578] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.311766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.311872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.312164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.312293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.312530] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.312633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.312696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.312900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.313200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.316132] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 61962cbf-a204-4999-8f33-d22fa9356972 is going to be updated. [ 795.340960] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.340960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.340960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.340960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.340960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.340960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61962cbf-a204-4999-8f33-d22fa9356972" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.480180] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: SUCCESS [ 795.480773] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.504852] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 795.505205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.506230] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 795.506230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.508152] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: SUCCESS [ 795.508152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.517129] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: SUCCESS [ 795.517802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.543521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 in Status: SUCCESS [ 795.543742] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.596290] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.596509] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.596640] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.596923] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.597211] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.597382] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.597508] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.597738] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.597882] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.598129] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 795.598524] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.598524] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.598524] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.598694] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 795.598694] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.598845] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.618048] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 in Status: SUCCESS [ 795.618298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.619449] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.619630] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 795.619778] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.620076] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.620528] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.620834] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.621098] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.621501] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.621662] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('775020de-b0cf-4c6b-ae14-e3e8a43c2e10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.666779] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: SUCCESS [ 795.666998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.701634] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.701818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.701818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.703108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.703108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.703108] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.703108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.703108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.703108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.703108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.703108] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be deleted. [ 795.732817] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.733106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.733164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.733438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.733560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.733706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.737615] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 795.737868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.738095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.738395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.738651] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.738810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.738911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.739223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.739276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.739412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.739547] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.810670] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('339605f7-09cd-456f-a3a0-4495fb59f075',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.124566] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.124911] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.125013] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.125392] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.125589] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.125756] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 775020de-b0cf-4c6b-ae14-e3e8a43c2e10 not found, creating... [ 796.126051] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.126218] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.126333] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.126677] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.126827] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.127144] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.127297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.127426] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.127647] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.127774] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.127923] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 775020de-b0cf-4c6b-ae14-e3e8a43c2e10 is going to be created. [ 796.155162] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.155560] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.155884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.156468] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.156824] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.157215] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.242190] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.242392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.242434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.242764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.243032] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.243167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.243228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.243411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.243500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.243635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.243767] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.243860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.243920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.244108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.244250] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.244340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.244399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.244588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.244618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.244691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.244781] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.288943] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 in Status: SUCCESS [ 796.289197] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ff5ba0af-d21f-4f03-b95d-0c41f57292b6 deletion is rescheduled due to dependency. [ 796.289303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ff5ba0af-d21f-4f03-b95d-0c41f57292b6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.313451] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.314558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.316367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.316766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.317963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.317963] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 339605f7-09cd-456f-a3a0-4495fb59f075 is going to be created. [ 796.370010] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.370220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.370284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.370484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.370664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.392866] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 339605f7-09cd-456f-a3a0-4495fb59f075 in Status: UNINITIALIZED for 2s [ 796.747956] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cf4d8d-838b-4bef-8391-fb65a3ba9c75: rpc.has_security_group_logging(os_id): False [ 796.768308] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.768710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.768710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.768807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.768836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.769060] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.769184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.769255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.769409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.769486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.769661] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.769760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.769823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.769961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.770045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.770238] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.770484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.770484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.770583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.770583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.770675] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be created. [ 796.829317] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.829462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.829534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.829739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.829915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.842071] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 796.892861] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3661896-6467-48e6-b679-8b0385a30e15 req-60c64870-0ac4-46bf-811d-6ac1c0c7553b service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 796.893471] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3661896-6467-48e6-b679-8b0385a30e15 req-60c64870-0ac4-46bf-811d-6ac1c0c7553b service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 796.893471] env[65106]: INFO networking_nsxv3.common.synchronization [req-a3661896-6467-48e6-b679-8b0385a30e15 req-60c64870-0ac4-46bf-811d-6ac1c0c7553b service nova] Enqueued Resource ID: 775020de-b0cf-4c6b-ae14-e3e8a43c2e10 with Priority: HIGHEST for action port [ 796.894082] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 796.894300] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 796.894446] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 775020de-b0cf-4c6b-ae14-e3e8a43c2e10 with Priority: HIGHEST for action port [ 796.894895] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.895014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.895143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.895381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.895495] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.896609] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.896716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.896831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.897171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.897414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.897564] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.897652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.897851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.898166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.898268] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.899172] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.899252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.899314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.899476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.899564] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('775020de-b0cf-4c6b-ae14-e3e8a43c2e10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.163224] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 797.163732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.401889] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.402039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.403522] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.404580] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 775020de-b0cf-4c6b-ae14-e3e8a43c2e10 with status ACTIVE [ 797.407055] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.407055] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.407055] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.407055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.407960] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 775020de-b0cf-4c6b-ae14-e3e8a43c2e10 is going to be updated. [ 797.434844] env[65106]: INFO networking_nsxv3.common.synchronization [req-6ad042a7-0ccd-432c-8ef0-19d6e1a3112f req-81aa9c71-7869-4748-bfb5-e8e1f6f8306c tempest-ListImageFiltersTestJSON-1907947682 tempest-ListImageFiltersTestJSON-1907947682-project-member] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 797.436596] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.436596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.436596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.436596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.436950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.436950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-775020de-b0cf-4c6b-ae14-e3e8a43c2e10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.437430] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 797.437775] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.437959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.437959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.438918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.438918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.438918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.438918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.438918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.439113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.439113] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.806458] env[65106]: INFO networking_nsxv3.common.synchronization [req-ac3db95b-19f7-437c-8856-5b816c701573 req-554a401a-4eeb-45f0-8bb9-96493d8c4aa5 tempest-ServerMetadataTestJSON-565346210 tempest-ServerMetadataTestJSON-565346210-project-member] Enqueued Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGHEST for action security_group_members [ 797.808537] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 with Priority: HIGHEST for action security_group_members [ 797.808918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-5b77c3b5-bcbc-4373-ba6a-5877c470d364 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.809060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.809125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.809318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.809469] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.810114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.810114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.810114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.810114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.810114] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5b77c3b5-bcbc-4373-ba6a-5877c470d364',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.909820] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.944548] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.006616] env[65106]: INFO networking_nsxv3.common.synchronization [req-ba52ab81-068c-40fc-8d15-4286d874c861 req-e5e51a0d-b778-457c-9bcb-4baf6c747190 tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 798.007174] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 798.007482] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.007606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.007671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.007870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.008233] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.008425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.008520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.008703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.008814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.009417] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.314179] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.314179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.314179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.314179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.314179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.315178] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.316074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.316074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.316074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.316222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.316255] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 is going to be updated. [ 798.347780] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.348038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.348142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.348692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.348890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.359665] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 in Status: IN_PROGRESS for 2s [ 798.403666] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 339605f7-09cd-456f-a3a0-4495fb59f075 in Status: SUCCESS [ 798.403666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.403666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.403848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.403880] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.403983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.404077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.404204] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.404295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.404360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.404439] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('339605f7-09cd-456f-a3a0-4495fb59f075',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.414186] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.414396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.414476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.414703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.414791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.414893] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be created. [ 798.445151] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.445151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.445151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.445151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.445151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.445151] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.451711] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: UNINITIALIZED for 2s [ 798.515054] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.515054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.515054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.515054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.515382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.515382] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.515520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.515520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.519031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.519031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.519031] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 798.548601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.548765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.548821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.552020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.552020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.559579] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 798.858294] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 798.858618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.910241] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-339605f7-09cd-456f-a3a0-4495fb59f075 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.910480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.910621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.910883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.911137] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.911295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.911401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.911599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.911732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.911862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.912067] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-339605f7-09cd-456f-a3a0-4495fb59f075 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.912271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.912347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.912529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.912714] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.913183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.913183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.913183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.913183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.913365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.913461] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('339605f7-09cd-456f-a3a0-4495fb59f075',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.947406] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.947589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.947685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.947911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.948016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.948122] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be updated. [ 798.979924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.980117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.980161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.980471] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.980671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.991140] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: IN_PROGRESS for 2s [ 799.085717] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f1035d6-7385-4ded-8ee6-a185a078a018 req-a68ab3bc-d7b2-481c-b072-b17de170cc49 tempest-AttachVolumeTestJSON-98661006 tempest-AttachVolumeTestJSON-98661006-project-member] Enqueued Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_members [ 799.086395] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_members [ 799.086856] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-611ce8e9-468b-46ff-b93b-ebf52e6cce82 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.086856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.087652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.087652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.087652] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.087652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.087652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.087652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.087995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.087995] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.416501] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 339605f7-09cd-456f-a3a0-4495fb59f075: rpc.has_security_group_logging(os_id): False [ 799.435549] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.435716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.435788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.436064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.437145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.437145] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.437145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.437145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.437145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.437145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.437145] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.437428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.437428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.437428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.437542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.437888] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.437888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.437888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.438043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.438074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.438152] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 339605f7-09cd-456f-a3a0-4495fb59f075 is going to be created. [ 799.477742] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.478818] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-978" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.479148] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-978" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.479495] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-978" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.480156] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.480156] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.480310] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.480554] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.480711] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.480929] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.481089] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.481267] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.481428] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.481567] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.481693] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.481892] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.502514] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.502671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.502738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.503077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.503295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.517636] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 339605f7-09cd-456f-a3a0-4495fb59f075 in Status: IN_PROGRESS for 2s [ 799.518599] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.518827] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.518889] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.519093] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-978" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.519392] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-4ff761e7-c601-48dc-a182-ac162b6d926d taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.519579] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-4ff761e7-c601-48dc-a182-ac162b6d926d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.519686] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-4ff761e7-c601-48dc-a182-ac162b6d926d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.520031] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-4ff761e7-c601-48dc-a182-ac162b6d926d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.520321] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff761e7-c601-48dc-a182-ac162b6d926d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.591809] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.591809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.591809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.592040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.592125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.592428] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.592428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.592593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.592593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.592684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.592728] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 already deleted. [ 799.592816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.027029] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.027029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.027029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.027029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.027029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.027029] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 4ff761e7-c601-48dc-a182-ac162b6d926d not found, creating... [ 800.027029] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.027029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.027029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.027029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.027029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.028085] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.028085] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.028085] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.028085] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.028085] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.028448] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 4ff761e7-c601-48dc-a182-ac162b6d926d is going to be created. [ 800.053429] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.054660] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.054931] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.055583] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.055583] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.056108] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-4ff761e7-c601-48dc-a182-ac162b6d926d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.371739] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 in Status: SUCCESS [ 800.371739] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5b77c3b5-bcbc-4373-ba6a-5877c470d364 deletion is rescheduled due to dependency. [ 800.372206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5b77c3b5-bcbc-4373-ba6a-5877c470d364" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.464699] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 800.466046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.466046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.466046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.466046] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.466046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.466046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.466046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.466046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.466046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.466046] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.571195] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 800.571195] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 800.571195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.773307] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f1035d6-7385-4ded-8ee6-a185a078a018 req-3f8e2659-4559-47e4-8cb0-df931df03c99 service nova] Enqueued Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_rules [ 800.773307] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f1035d6-7385-4ded-8ee6-a185a078a018 req-3f8e2659-4559-47e4-8cb0-df931df03c99 service nova] Enqueued Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_members [ 800.773307] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f1035d6-7385-4ded-8ee6-a185a078a018 req-3f8e2659-4559-47e4-8cb0-df931df03c99 service nova] Enqueued Resource ID: 4ff761e7-c601-48dc-a182-ac162b6d926d with Priority: HIGHEST for action port [ 800.773307] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_rules [ 800.773307] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_members [ 800.773307] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff761e7-c601-48dc-a182-ac162b6d926d with Priority: HIGHEST for action port [ 800.773307] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.773574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.773574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.773738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.773820] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.774830] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-611ce8e9-468b-46ff-b93b-ebf52e6cce82 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.774961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.775095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.776080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.776220] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.776332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.776398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.776576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.776647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.776744] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.780244] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff761e7-c601-48dc-a182-ac162b6d926d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.780377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff761e7-c601-48dc-a182-ac162b6d926d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.780454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff761e7-c601-48dc-a182-ac162b6d926d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.780653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff761e7-c601-48dc-a182-ac162b6d926d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.780737] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff761e7-c601-48dc-a182-ac162b6d926d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.971074] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.971236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.971313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.971547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.971718] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.971818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.971881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.972211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.972211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.972211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.972372] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.972464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.972519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.972657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.972791] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.972897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.972969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.973201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.973297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.973382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.973484] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.000596] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: SUCCESS [ 801.000817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.076514] env[65106]: INFO networking_nsxv3.common.synchronization [req-6b7c05ee-e12a-4ac4-8050-4b193a90c85b req-b4768b68-c269-44d1-8f5f-e69a4634ea83 tempest-ImagesOneServerNegativeTestJSON-531782934 tempest-ImagesOneServerNegativeTestJSON-531782934-project-member] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 801.080026] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 801.080026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.080026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.080026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.080026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.080026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.080026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.080026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.080026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.080026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.080026] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.283083] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.283766] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-611ce8e9-468b-46ff-b93b-ebf52e6cce82 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.283911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.284179] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4ff761e7-c601-48dc-a182-ac162b6d926d with status ACTIVE [ 801.284303] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.284437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.284530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.284764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.284863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.285056] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.285508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.285508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.286649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.286649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.286649] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.286858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.286858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.286960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.287026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.287080] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4ff761e7-c601-48dc-a182-ac162b6d926d is going to be updated. [ 801.322040] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.322040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.322040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.322403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.322525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.323240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff761e7-c601-48dc-a182-ac162b6d926d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.476458] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4b9f28-129e-4614-b2d6-9173d8122416: rpc.has_security_group_logging(os_id): False [ 801.495685] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.495817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.495878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.496107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.496199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.496506] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.496592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.496592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.496763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.496848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.497354] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.497354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.497354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.497354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.497584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.497626] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.497690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.497756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.497904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.498018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.498118] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be created. [ 801.553478] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 339605f7-09cd-456f-a3a0-4495fb59f075 in Status: SUCCESS [ 801.553711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.581798] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.582063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.582129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.582337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.582427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.582643] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.582739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.582797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.582964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.583105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.583231] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 801.606254] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.606438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.606510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.606756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.607593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.623979] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 801.628341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.628490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.628560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.628870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.629048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.639276] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 801.789093] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.948615] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef9eac31-9c2f-4151-a714-93f04cbc508a req-413af52e-be91-44cb-9319-29a367adc503 tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 801.949342] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 801.949984] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.950148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.950228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.950507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.950714] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.950981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.951316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.951543] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.951627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.951729] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.291992] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.292322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.292360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.292560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.292649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.292752] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 is going to be created. [ 802.333622] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.333740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.334032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.334355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.334584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.348987] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 in Status: UNINITIALIZED for 2s [ 802.385195] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef9eac31-9c2f-4151-a714-93f04cbc508a req-5a528dbc-2c28-4cf7-8315-4210bc8bef8c tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 802.385836] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 802.391111] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.391401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.457918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.457918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.457918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.457918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.457918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.457918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.457918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.457918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.457918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.457918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.458446] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be deleted. [ 802.490022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.490022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.490022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.490022] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.773021] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-291 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.773021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-291" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.773021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-291" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.773411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-291" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.774209] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.776058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.776058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.776058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.776058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.776058] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.776058] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.776058] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.776058] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.776502] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.777146] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.777146] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.800431] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.800608] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.800747] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.800923] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-291" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.802124] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.802124] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.802124] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.802124] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.802124] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.993643] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.993906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.993906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.994309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.994472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.994776] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.994962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.995077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.995272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.995349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.995465] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e already deleted. [ 802.995555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.304747] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.306103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.306103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.306103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.306103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.306103] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9 not found, creating... [ 803.306103] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.306961] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.307170] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.307541] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.307837] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.308224] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.308469] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.308619] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.308922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.309271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.309467] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9 is going to be created. [ 803.341649] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.341993] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.342140] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.342436] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.342678] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.343454] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.637860] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 803.639154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.649227] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 803.649414] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd deletion is rescheduled due to dependency. [ 803.649514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.050174] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef9eac31-9c2f-4151-a714-93f04cbc508a req-c98b8d69-4915-430a-865c-34b65664c4b9 service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 804.050425] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef9eac31-9c2f-4151-a714-93f04cbc508a req-c98b8d69-4915-430a-865c-34b65664c4b9 service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 804.050481] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef9eac31-9c2f-4151-a714-93f04cbc508a req-c98b8d69-4915-430a-865c-34b65664c4b9 service nova] Enqueued Resource ID: cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9 with Priority: HIGHEST for action port [ 804.053681] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 804.053957] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 804.054406] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9 with Priority: HIGHEST for action port [ 804.055186] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.055349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.055428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.055731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.055846] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.058918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.059056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.059286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.059433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.059745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.059883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.059961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.060941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.060941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.060941] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.061474] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.062180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.062180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.062180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.062180] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.359073] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 in Status: SUCCESS [ 804.359384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.359493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.359706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.359898] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.360026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.360093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.360260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.360361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.360464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.360581] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.528711] env[65106]: INFO networking_nsxv3.common.synchronization [req-f56ee0f6-3540-4842-a8b3-ab261672998e req-be79967d-2948-4ad3-93b3-ff17630b9e4c tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 804.529337] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 804.529691] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.529814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.529852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.530065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.530217] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.530317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.530375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.530596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.530596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.530685] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.563791] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.564988] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.565138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.566036] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9 with status ACTIVE [ 804.566036] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.566036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.566036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.566036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.566036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.566463] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.566598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.566680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.567608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.567608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.567608] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.567608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.567608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.567608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.567839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.567920] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9 is going to be updated. [ 804.589591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.589732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.589809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.590109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.590369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.590574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb105f9c-a6d5-4ea0-8c52-8b6b0abcf7f9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.700679] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-944057f9-17eb-4d71-9a67-1e11f71c9136 tempest-ListServersNegativeTestJSON-814622823 tempest-ListServersNegativeTestJSON-814622823-project-member] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 804.701838] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 804.701838] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.705279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.705531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.705780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.706451] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.706845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.706845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.710141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.710141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.710141] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.863711] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.884175] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-730 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.884492] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-730" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.884741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-730" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.885130] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-730" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.885489] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.885720] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.885886] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.886194] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.886386] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.886667] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.886847] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.887018] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.887191] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.887326] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.887446] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.887584] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.911684] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.911684] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.912196] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.915636] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-730" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.916018] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-cfc17557-1dc1-4762-8129-5056cbb1d904 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.916213] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-cfc17557-1dc1-4762-8129-5056cbb1d904" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.916332] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-cfc17557-1dc1-4762-8129-5056cbb1d904" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.916651] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-cfc17557-1dc1-4762-8129-5056cbb1d904" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.916789] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfc17557-1dc1-4762-8129-5056cbb1d904',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.033118] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.033330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.033403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.033659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.033794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.033940] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.034289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.034414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.034582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.034662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.034757] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 805.067306] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.068109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.068109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.068259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.068376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.069904] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.079971] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 805.099626] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.099826] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.099947] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.100351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.100618] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.100773] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.100884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.101178] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.101333] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.101534] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.101639] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 805.101741] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 805.101839] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 805.101940] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 805.102050] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 805.102179] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 805.122329] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 805.122526] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 805.122664] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 805.122836] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.123237] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-c7be3ae2-dbae-495f-93b6-5783c7a0885c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.123445] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-c7be3ae2-dbae-495f-93b6-5783c7a0885c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.123573] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-c7be3ae2-dbae-495f-93b6-5783c7a0885c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.123881] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-c7be3ae2-dbae-495f-93b6-5783c7a0885c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.124032] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7be3ae2-dbae-495f-93b6-5783c7a0885c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.210107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.210307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.210385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.210613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.210698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.210898] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.211125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.211198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.211361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.211443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.211548] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 already deleted. [ 805.211634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.366934] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 611ce8e9-468b-46ff-b93b-ebf52e6cce82: rpc.has_security_group_logging(os_id): False [ 805.386238] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.386392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.386392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.386593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.386680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.386926] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.387050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.387112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.387244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.387319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.387407] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 is going to be created. [ 805.419425] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.419671] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.419770] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.420050] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.420207] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.420361] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port cfc17557-1dc1-4762-8129-5056cbb1d904 not found, creating... [ 805.420617] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.420764] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.420874] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.421166] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.421298] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.421578] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.421731] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.421846] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.422057] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.422232] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.422383] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: cfc17557-1dc1-4762-8129-5056cbb1d904 is going to be created. [ 805.443987] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.444268] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.444393] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.444705] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.444958] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.445210] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-cfc17557-1dc1-4762-8129-5056cbb1d904" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.452493] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.452639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.452706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.452911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.453192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.466031] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 in Status: IN_PROGRESS for 2s [ 805.573347] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.573586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.573586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.573844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.573938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.574091] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be created. [ 805.627475] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.627984] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.628220] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.628550] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.628733] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.628950] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port c7be3ae2-dbae-495f-93b6-5783c7a0885c not found, creating... [ 805.629369] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.629655] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.629746] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.629949] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.631287] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.632339] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.632608] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.632779] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.633235] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.633415] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.633571] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: c7be3ae2-dbae-495f-93b6-5783c7a0885c is going to be created. [ 805.635986] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.636164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.636207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.636461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.636681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.651985] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: UNINITIALIZED for 2s [ 805.674453] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.674806] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.675019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.675356] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.675770] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.676098] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-c7be3ae2-dbae-495f-93b6-5783c7a0885c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.158175] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef9eac31-9c2f-4151-a714-93f04cbc508a req-31a4ef29-863c-477d-8e4f-d221492d60ed service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 806.158175] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef9eac31-9c2f-4151-a714-93f04cbc508a req-31a4ef29-863c-477d-8e4f-d221492d60ed service nova] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 806.158175] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef9eac31-9c2f-4151-a714-93f04cbc508a req-31a4ef29-863c-477d-8e4f-d221492d60ed service nova] Enqueued Resource ID: cfc17557-1dc1-4762-8129-5056cbb1d904 with Priority: HIGHEST for action port [ 806.158642] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_rules [ 806.158775] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 806.158872] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cfc17557-1dc1-4762-8129-5056cbb1d904 with Priority: HIGHEST for action port [ 806.159222] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.159289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.159444] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.159522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.159695] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-cfc17557-1dc1-4762-8129-5056cbb1d904 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.159785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cfc17557-1dc1-4762-8129-5056cbb1d904" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.159841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cfc17557-1dc1-4762-8129-5056cbb1d904" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.160059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cfc17557-1dc1-4762-8129-5056cbb1d904" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.160145] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cfc17557-1dc1-4762-8129-5056cbb1d904',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.354258] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-f6b167e2-3402-4635-9e1a-b329f9f140e6 service nova] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_rules [ 806.354394] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-f6b167e2-3402-4635-9e1a-b329f9f140e6 service nova] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 806.354506] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-f6b167e2-3402-4635-9e1a-b329f9f140e6 service nova] Enqueued Resource ID: c7be3ae2-dbae-495f-93b6-5783c7a0885c with Priority: HIGHEST for action port [ 806.355070] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_rules [ 806.355263] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 806.355337] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7be3ae2-dbae-495f-93b6-5783c7a0885c with Priority: HIGHEST for action port [ 806.355630] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.355758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.355824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.356387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.356523] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.357590] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.358797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.358915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.359256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.359508] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.359913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.359913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.360107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.360277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.361344] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.362955] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-c7be3ae2-dbae-495f-93b6-5783c7a0885c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.363236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c7be3ae2-dbae-495f-93b6-5783c7a0885c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.363366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c7be3ae2-dbae-495f-93b6-5783c7a0885c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.363880] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c7be3ae2-dbae-495f-93b6-5783c7a0885c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.364494] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c7be3ae2-dbae-495f-93b6-5783c7a0885c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.663203] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cfc17557-1dc1-4762-8129-5056cbb1d904 with status ACTIVE [ 806.663488] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.663595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.663659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.663869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.663953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.664145] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.664237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.665102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.665102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.665102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.665102] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.665102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.665102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.665102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.665102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.665425] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cfc17557-1dc1-4762-8129-5056cbb1d904 is going to be updated. [ 806.689543] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.689783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.690027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.690283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.690455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.690761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cfc17557-1dc1-4762-8129-5056cbb1d904" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.769824] env[65106]: INFO networking_nsxv3.common.synchronization [req-5911cbd7-b068-49f5-a2c9-e5cee3870532 req-e0d18b98-94a8-4801-a148-d33d325e7beb tempest-ServerExternalEventsTest-376125758 tempest-ServerExternalEventsTest-376125758-project-member] Enqueued Resource ID: 339605f7-09cd-456f-a3a0-4495fb59f075 with Priority: HIGHEST for action security_group_members [ 806.770368] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 339605f7-09cd-456f-a3a0-4495fb59f075 with Priority: HIGHEST for action security_group_members [ 806.770640] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-339605f7-09cd-456f-a3a0-4495fb59f075 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.770758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.770824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.772414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.772414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.772414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.772591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.772944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.772944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.772944] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('339605f7-09cd-456f-a3a0-4495fb59f075',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.868227] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.868227] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.868227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.871249] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c7be3ae2-dbae-495f-93b6-5783c7a0885c with status ACTIVE [ 806.871249] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.871249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.871249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.871249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.871249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.871495] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.871495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.871577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.871688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.871766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.872328] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.872328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.872499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.872536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.873454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.873454] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c7be3ae2-dbae-495f-93b6-5783c7a0885c is going to be updated. [ 806.909220] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.909220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.909220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.909438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.909651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.909901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c7be3ae2-dbae-495f-93b6-5783c7a0885c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.091599] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 807.091787] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 807.091965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.275675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.275864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.275908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.277127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.277236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.277446] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.277553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.277616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.277788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.277862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.277946] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 339605f7-09cd-456f-a3a0-4495fb59f075 is going to be updated. [ 807.309883] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.309883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.310106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.310342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.310342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.320105] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 339605f7-09cd-456f-a3a0-4495fb59f075 in Status: IN_PROGRESS for 2s [ 807.369790] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.376833] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-b3323803-80a2-4e5c-a794-ad4d02ff3cf2 tempest-ListServersNegativeTestJSON-814622823 tempest-ListServersNegativeTestJSON-814622823-project-member] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 807.377522] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 807.377773] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.377878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.479329] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 in Status: SUCCESS [ 807.479329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.663599] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 807.663906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.664044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.667043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.667043] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.667043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.667043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.667043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.667043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.667043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.667043] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.667477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.667477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.667477] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.667576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.667576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.668536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.668536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.668536] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.727285] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.727535] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.727736] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.728904] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.728904] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.728904] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.728904] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.729189] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.729295] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.729573] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.729755] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.729934] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.730124] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.730318] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.730503] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.730731] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.753555] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.753746] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 807.753881] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.755020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.755020] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-d3f5f939-d217-478e-8474-d0b67d1a5924 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.755020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-d3f5f939-d217-478e-8474-d0b67d1a5924" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.755020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-d3f5f939-d217-478e-8474-d0b67d1a5924" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.755296] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-d3f5f939-d217-478e-8474-d0b67d1a5924" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.755420] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f5f939-d217-478e-8474-d0b67d1a5924',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.873459] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.874060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.874060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.874060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.874060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.874347] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be created. [ 807.899346] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.899504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.899504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.901020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.901020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.910599] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: UNINITIALIZED for 2s [ 808.167610] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.168019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.171263] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.259050] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.259338] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.259476] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.259822] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.259994] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.260325] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port d3f5f939-d217-478e-8474-d0b67d1a5924 not found, creating... [ 808.260667] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.260882] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.261297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.261603] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.261821] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.262191] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.262368] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.262539] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.262837] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.262982] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.263182] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: d3f5f939-d217-478e-8474-d0b67d1a5924 is going to be created. [ 808.294958] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.295364] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.295568] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.296050] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.296405] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.296731] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-d3f5f939-d217-478e-8474-d0b67d1a5924" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.674648] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.022607] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-1f512c16-5017-4b2a-9432-3fc0c3feb200 service nova] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_rules [ 809.022607] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-1f512c16-5017-4b2a-9432-3fc0c3feb200 service nova] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 809.022607] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-1f512c16-5017-4b2a-9432-3fc0c3feb200 service nova] Enqueued Resource ID: d3f5f939-d217-478e-8474-d0b67d1a5924 with Priority: HIGHEST for action port [ 809.022949] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_rules [ 809.022949] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 809.023031] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3f5f939-d217-478e-8474-d0b67d1a5924 with Priority: HIGHEST for action port [ 809.023358] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.023492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.023721] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.023807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.023995] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3f5f939-d217-478e-8474-d0b67d1a5924 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.024123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3f5f939-d217-478e-8474-d0b67d1a5924" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.024905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3f5f939-d217-478e-8474-d0b67d1a5924" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.024905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3f5f939-d217-478e-8474-d0b67d1a5924" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.024905] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3f5f939-d217-478e-8474-d0b67d1a5924',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.177277] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.177417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.177492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.177991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.177991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.177991] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 809.208405] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.208405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.208405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.208405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.208405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.216564] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 809.330293] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 339605f7-09cd-456f-a3a0-4495fb59f075 in Status: SUCCESS [ 809.330471] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 339605f7-09cd-456f-a3a0-4495fb59f075 deletion is rescheduled due to dependency. [ 809.330583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-339605f7-09cd-456f-a3a0-4495fb59f075" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.531303] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3f5f939-d217-478e-8474-d0b67d1a5924 with status ACTIVE [ 809.531594] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.531771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.531874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.532166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.532263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.532442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.532540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.532602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.532750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.532824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.533016] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.533198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.533339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.533538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.533617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.533704] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3f5f939-d217-478e-8474-d0b67d1a5924 is going to be updated. [ 809.554812] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.554953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.555033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.555302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.555463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.555623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3f5f939-d217-478e-8474-d0b67d1a5924" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.920881] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 809.921255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.921316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.921536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.921726] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.921983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.921983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.922141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.922141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.922381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.922381] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.923836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.924019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.924284] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.924396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.924459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.924603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.924879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.924879] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.326200] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-0188bf54-2051-4b86-8fe1-b56e38b4cba3 tempest-ListServersNegativeTestJSON-814622823 tempest-ListServersNegativeTestJSON-814622823-project-member] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 810.326423] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 810.326722] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.327326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.425871] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.426076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.427640] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.693256] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-373 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.693256] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.693256] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.693256] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.693559] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.693655] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.693764] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.693966] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.694578] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.694802] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.694934] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.695025] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.695131] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.695235] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.695334] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.696330] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.715318] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.715725] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.716871] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.716871] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-373" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.716871] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-d3be6d63-477e-4811-a014-45de0ba40bfc taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.716871] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-d3be6d63-477e-4811-a014-45de0ba40bfc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.717264] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-d3be6d63-477e-4811-a014-45de0ba40bfc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.717826] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-d3be6d63-477e-4811-a014-45de0ba40bfc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.717826] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3be6d63-477e-4811-a014-45de0ba40bfc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.932541] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.220239] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.220529] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.220754] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.221118] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.221331] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.221518] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port d3be6d63-477e-4811-a014-45de0ba40bfc not found, creating... [ 811.221843] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.222077] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.222213] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.222441] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.222605] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.222894] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.223155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.223253] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.223419] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.223568] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.223705] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: d3be6d63-477e-4811-a014-45de0ba40bfc is going to be created. [ 811.225916] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 4s [ 811.241981] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.242207] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.242331] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.242592] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.242816] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.243053] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-d3be6d63-477e-4811-a014-45de0ba40bfc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.435690] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.435978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.435978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.436219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.436324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.436468] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 811.486388] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.486388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.486388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.486603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.486785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.523505] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 812.005732] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-87f6612c-226a-4f7b-9080-0111d89c7d1b service nova] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_rules [ 812.006358] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-87f6612c-226a-4f7b-9080-0111d89c7d1b service nova] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 812.006358] env[65106]: INFO networking_nsxv3.common.synchronization [req-be0bf93c-312c-4f19-b8d1-01c530e910c8 req-87f6612c-226a-4f7b-9080-0111d89c7d1b service nova] Enqueued Resource ID: d3be6d63-477e-4811-a014-45de0ba40bfc with Priority: HIGHEST for action port [ 812.006687] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_rules [ 812.006800] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 812.006883] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3be6d63-477e-4811-a014-45de0ba40bfc with Priority: HIGHEST for action port [ 812.007294] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.007424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.007659] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.007739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.007951] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3be6d63-477e-4811-a014-45de0ba40bfc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.008059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3be6d63-477e-4811-a014-45de0ba40bfc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.008098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3be6d63-477e-4811-a014-45de0ba40bfc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.008275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3be6d63-477e-4811-a014-45de0ba40bfc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.008352] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3be6d63-477e-4811-a014-45de0ba40bfc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.511285] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d3be6d63-477e-4811-a014-45de0ba40bfc with status ACTIVE [ 812.511535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.511673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.511746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.512793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.512793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.512793] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.512793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.512793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.512793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.512793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.513478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.513478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.513478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.513801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.513801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.513886] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d3be6d63-477e-4811-a014-45de0ba40bfc is going to be updated. [ 812.537666] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.537861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.537861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.538101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.538281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.538397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3be6d63-477e-4811-a014-45de0ba40bfc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.032782] env[65106]: INFO networking_nsxv3.common.synchronization [req-df6059f7-d850-4c7e-8271-4ec363a87dca req-d26ab183-7a48-4f72-b723-dc23a553c856 tempest-ServerMetadataNegativeTestJSON-1845275320 tempest-ServerMetadataNegativeTestJSON-1845275320-project-member] Enqueued Resource ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a with Priority: HIGHEST for action security_group_members [ 813.033751] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a with Priority: HIGHEST for action security_group_members [ 813.034017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.034211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.034389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.034987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.034987] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.034987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.035244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.035244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.035322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.035401] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfd09ac0-101c-4f4a-a6a9-9a67108ff64a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.239811] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 813.239962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.240223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.240483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.240688] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.240851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.240884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.241142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.241249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.241341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.241519] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.241616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.241671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.241820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.242410] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.242410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.242410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.244094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.244094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.244094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.244094] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.537751] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 813.538154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.538655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.539084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.539445] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.539728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.539807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.540099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.540288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.540480] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.543620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.543775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.543821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.544024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.544116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.544357] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.544511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.544585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.544785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.544899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.545020] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a already deleted. [ 813.545141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.546502] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-203 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.546752] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-203" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.546888] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-203" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.547197] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-203" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.548788] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.548788] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.548788] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.548788] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.548788] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.548788] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.548788] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 813.548788] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 813.548788] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 813.548788] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 813.548788] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 813.549290] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 813.580028] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 813.580028] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 813.580028] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 813.580028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-203" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.580028] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-0aded930-34b1-40e5-b2fc-eb23c124c19f taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.580705] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-0aded930-34b1-40e5-b2fc-eb23c124c19f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.581132] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-0aded930-34b1-40e5-b2fc-eb23c124c19f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.581841] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-0aded930-34b1-40e5-b2fc-eb23c124c19f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.582288] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aded930-34b1-40e5-b2fc-eb23c124c19f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.747264] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52a63c62-ab68-4afc-b239-81d4bb46173e: rpc.has_security_group_logging(os_id): False [ 813.887739] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.887970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.888094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.888379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.888503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.888796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.888913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.889116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.889159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.889254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.889451] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.889577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.889651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.889865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.889949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.890266] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.890437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.890437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.890572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.890648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.890737] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be created. [ 813.983569] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.983796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.983796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.983999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.984299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.005553] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 814.051374] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.085817] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.086117] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.086314] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.088154] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.088154] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.088362] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 0aded930-34b1-40e5-b2fc-eb23c124c19f not found, creating... [ 814.088698] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.088890] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.089080] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.091498] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.091933] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.092226] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.092475] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.092817] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.093093] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.093267] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.093478] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 0aded930-34b1-40e5-b2fc-eb23c124c19f is going to be created. [ 814.138481] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.138825] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.139056] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.139483] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.139862] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.140242] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-0aded930-34b1-40e5-b2fc-eb23c124c19f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.554710] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.870792] env[65106]: INFO networking_nsxv3.common.synchronization [req-df6059f7-d850-4c7e-8271-4ec363a87dca req-07618715-02d0-4e80-a047-7d6d70fc9b6c service nova] Enqueued Resource ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a with Priority: HIGHEST for action security_group_rules [ 814.870993] env[65106]: INFO networking_nsxv3.common.synchronization [req-df6059f7-d850-4c7e-8271-4ec363a87dca req-07618715-02d0-4e80-a047-7d6d70fc9b6c service nova] Enqueued Resource ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a with Priority: HIGHEST for action security_group_members [ 814.871112] env[65106]: INFO networking_nsxv3.common.synchronization [req-df6059f7-d850-4c7e-8271-4ec363a87dca req-07618715-02d0-4e80-a047-7d6d70fc9b6c service nova] Enqueued Resource ID: 0aded930-34b1-40e5-b2fc-eb23c124c19f with Priority: HIGHEST for action port [ 814.871770] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a with Priority: HIGHEST for action security_group_rules [ 814.871903] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a with Priority: HIGHEST for action security_group_members [ 814.872007] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aded930-34b1-40e5-b2fc-eb23c124c19f with Priority: HIGHEST for action port [ 814.872335] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.872502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.872566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.872852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.872958] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bfd09ac0-101c-4f4a-a6a9-9a67108ff64a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.873974] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.874180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.874180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.874384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.874568] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.874678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.874738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.874885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.874969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.875079] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfd09ac0-101c-4f4a-a6a9-9a67108ff64a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.876301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aded930-34b1-40e5-b2fc-eb23c124c19f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.876521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aded930-34b1-40e5-b2fc-eb23c124c19f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.876521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aded930-34b1-40e5-b2fc-eb23c124c19f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.876614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aded930-34b1-40e5-b2fc-eb23c124c19f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.876689] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aded930-34b1-40e5-b2fc-eb23c124c19f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.058727] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.059069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.059239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.059523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.059627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.059762] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 815.098275] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.098474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.098574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.099243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.099446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.110152] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 815.379360] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.379854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.379854] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bfd09ac0-101c-4f4a-a6a9-9a67108ff64a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.381650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0aded930-34b1-40e5-b2fc-eb23c124c19f with status ACTIVE [ 815.381847] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.382021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.382116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.382403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.382462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.382653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.383368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.383368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.383368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.383368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.383368] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.383368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.383778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.383778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.383778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.383778] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0aded930-34b1-40e5-b2fc-eb23c124c19f is going to be updated. [ 815.409078] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.409247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.409320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.409540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.409692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.409866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aded930-34b1-40e5-b2fc-eb23c124c19f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.882627] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bfd09ac0-101c-4f4a-a6a9-9a67108ff64a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.029898] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 816.030242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.030952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.031246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.031364] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.386058] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.386058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.386058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.386479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.386670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.388456] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a is going to be created. [ 816.420593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.420754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.420795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.421019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.421191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.435135] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a in Status: UNINITIALIZED for 2s [ 816.534850] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.535044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.535103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.535324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.535966] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.535966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.535966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.535966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.535966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.538176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.538176] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.039693] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.039885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.039984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.040329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.040575] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.040736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.040826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.041067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.041209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.041379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.041612] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.041761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.041864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.042153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.042428] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.042583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.042697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.042965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.044674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.044674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.044674] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.123685] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 817.123883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.124114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.124385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.131489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.131489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.131489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.131489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.131489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.131489] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.547847] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52a63c62-ab68-4afc-b239-81d4bb46173e: rpc.has_security_group_logging(os_id): False [ 817.572857] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.573270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.573470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.573792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.573867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.574214] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.574361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.574361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.574589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.574682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.574949] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.575133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.575231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.575306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.575408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.576097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.576097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.576097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.576097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.576097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.576097] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 817.634927] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.680861] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.681150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.681150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.681492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.681708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.706770] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 818.137702] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.146461] env[65106]: INFO networking_nsxv3.common.synchronization [req-11f87421-2563-4d0b-9747-5aa9d381de5f req-42a11888-7d2c-4f59-aa2e-b81815291698 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 818.148651] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 818.149809] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.150186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.150803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.150911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.151530] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.151780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.152138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.152667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.152869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.153058] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.170293] env[65106]: INFO networking_nsxv3.common.synchronization [req-11f87421-2563-4d0b-9747-5aa9d381de5f req-42a11888-7d2c-4f59-aa2e-b81815291698 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 818.170506] env[65106]: INFO networking_nsxv3.common.synchronization [req-11f87421-2563-4d0b-9747-5aa9d381de5f req-42a11888-7d2c-4f59-aa2e-b81815291698 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 818.170657] env[65106]: INFO networking_nsxv3.common.synchronization [req-11f87421-2563-4d0b-9747-5aa9d381de5f req-42a11888-7d2c-4f59-aa2e-b81815291698 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 7237cabd-cc25-410b-a518-5f70a471b2de with Priority: HIGHEST for action port [ 818.172915] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 818.173349] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 818.173737] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7237cabd-cc25-410b-a518-5f70a471b2de with Priority: HIGHEST for action port [ 818.174766] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.174874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.174874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.175066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.175158] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.177787] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.177787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.177787] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7237cabd-cc25-410b-a518-5f70a471b2de taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.177787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.178119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.178119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.178119] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7237cabd-cc25-410b-a518-5f70a471b2de',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.359740] env[65106]: INFO networking_nsxv3.common.synchronization [req-199f4fb2-ff9d-409c-a06a-53c9477dcfb1 req-bfe55e72-87cd-4ee5-9ebb-1f669781fd9b tempest-ServersAdminTestJSON-1615839610 tempest-ServersAdminTestJSON-1615839610-project-member] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 818.360806] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 818.360806] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.361069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.361069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.361350] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.361504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.361602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.361660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.362354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.362354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.362354] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.449029] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a in Status: SUCCESS [ 818.449207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.449725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.450149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.450262] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.450346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.450386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.451462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.451462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.451462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.451462] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bfd09ac0-101c-4f4a-a6a9-9a67108ff64a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.641051] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.641051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.641435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.641435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.641435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.641525] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 818.657830] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.674023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.674023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.674023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.674023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.674023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.680036] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.680176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.682481] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7237cabd-cc25-410b-a518-5f70a471b2de with status ACTIVE [ 818.682692] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.682817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.683095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.683183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.683238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.683416] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.683513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.683562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.683729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.683821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.684060] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.686387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.686483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.686636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.686760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.686814] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7237cabd-cc25-410b-a518-5f70a471b2de is going to be updated. [ 818.689861] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 818.715811] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.715985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.716041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.716269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.716411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.716572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.864968] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.955352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.955814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.955914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.956196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.956348] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.956448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.956508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.958424] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.958424] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.958424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.958424] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bfd09ac0-101c-4f4a-a6a9-9a67108ff64a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.160421] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.366968] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.461452] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bfd09ac0-101c-4f4a-a6a9-9a67108ff64a: rpc.has_security_group_logging(os_id): False [ 819.480993] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.481227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.481295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.481578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.481701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.481960] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.482100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.482191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.482394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.482516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.482728] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.482861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.482909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.483083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.483264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.483472] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.483562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.483630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.483761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.483835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.483920] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a is going to be created. [ 819.553952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.554107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.554187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.554458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.554657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.566727] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a in Status: IN_PROGRESS for 2s [ 819.665134] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.665134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.665134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.665134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.665134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.665134] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d is going to be updated. [ 819.695189] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.695446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.695446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.695890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.695969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.707611] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: IN_PROGRESS for 2s [ 819.728327] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 819.728327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.876705] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.876942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.877033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.877351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.877454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.877564] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 819.915954] env[65106]: INFO networking_nsxv3.common.synchronization [req-718d1d4e-69eb-4850-bf20-d36b6f0227d1 req-f3dd27e4-781a-43d4-a953-3d8726d35948 tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 819.917432] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 819.917836] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.917996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.918098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.919859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.919859] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.919859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.919859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.919859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.919859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.919859] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.921552] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.921675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.921739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.921930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.922088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.942033] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 820.223183] env[65106]: INFO networking_nsxv3.common.synchronization [req-718d1d4e-69eb-4850-bf20-d36b6f0227d1 req-6c96a67e-32f9-4c52-86e3-57e1bfa1a74b tempest-ServersTestMultiNic-1514055621 tempest-ServersTestMultiNic-1514055621-project-member] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 820.223759] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGHEST for action security_group_members [ 820.224980] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.225152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.427060] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.701808] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 820.702122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.702696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.703660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.703949] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.704097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.704748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.704748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.704748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.704748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.704748] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.705155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.705155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.705529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.705529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.705529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.705701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.705819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.705819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.705888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.705974] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.706835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.707751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.707751] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.707751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.707751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.707751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.707751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.707751] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.930279] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.932735] env[65106]: INFO networking_nsxv3.common.synchronization [req-85798a1e-330e-4c04-a788-92fa5e827502 req-bc87deb8-f7b1-4a9e-89e5-e43a434b5f14 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 820.933763] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 820.934322] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.934493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.947861] env[65106]: INFO networking_nsxv3.common.synchronization [req-85798a1e-330e-4c04-a788-92fa5e827502 req-bc87deb8-f7b1-4a9e-89e5-e43a434b5f14 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 820.948173] env[65106]: INFO networking_nsxv3.common.synchronization [req-85798a1e-330e-4c04-a788-92fa5e827502 req-bc87deb8-f7b1-4a9e-89e5-e43a434b5f14 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 820.948414] env[65106]: INFO networking_nsxv3.common.synchronization [req-85798a1e-330e-4c04-a788-92fa5e827502 req-bc87deb8-f7b1-4a9e-89e5-e43a434b5f14 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 7237cabd-cc25-410b-a518-5f70a471b2de with Priority: HIGHEST for action port [ 820.949534] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_rules [ 820.949743] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 820.949895] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7237cabd-cc25-410b-a518-5f70a471b2de with Priority: HIGHEST for action port [ 820.950785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.950785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.951080] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.951219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.951508] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7237cabd-cc25-410b-a518-5f70a471b2de taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.951677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.951771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.952085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.952263] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7237cabd-cc25-410b-a518-5f70a471b2de',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.209904] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89b2fdad-d445-45cc-854d-bad422551520: rpc.has_security_group_logging(os_id): False [ 821.212038] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.235951] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.236487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.236487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.236892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.237091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.237525] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.237718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.237880] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.238254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.238428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.238849] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.239062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.239159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.239345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.239433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.239706] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.239812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.239877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.240038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.240165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.240203] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be created. [ 821.319073] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.319073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.319073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.319073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.319073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.340288] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 821.435243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.435243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.435243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.435243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.435243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.435576] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 821.455543] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7237cabd-cc25-410b-a518-5f70a471b2de with status ACTIVE [ 821.455844] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.456137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.456319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.456580] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.456675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.456981] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.457144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.457287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.457438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.457523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.457718] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.457832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.457886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.458041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.458184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.458184] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7237cabd-cc25-410b-a518-5f70a471b2de is going to be updated. [ 821.499501] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.499770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.499884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.500241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.500485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.500745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7237cabd-cc25-410b-a518-5f70a471b2de" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.525591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.525825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.525825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.526313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.526488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.539541] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 821.580970] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a in Status: SUCCESS [ 821.581331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.716256] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.717993] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: SUCCESS [ 821.718217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.718379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.718763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.718763] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.718925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.718925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.719084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.719162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.719255] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.953118] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 821.953292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.220942] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.221130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.221356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.221600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.221749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.221830] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 822.223811] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.259434] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.259577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.259577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.259894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.260136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.269555] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 822.726559] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.231124] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.231454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.231454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.231697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.231799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.231904] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d is going to be updated. [ 823.271628] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.271825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.271900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.272161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.272320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.284860] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: IN_PROGRESS for 2s [ 823.365791] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 823.366046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.366236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.366549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.366672] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.553766] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 823.553964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.556267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.556267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.556267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.556267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.556267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.556267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.556267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.556267] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.871232] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.871544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.060478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.060478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.060478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.060478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.066023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.066023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.066023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.066023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.066023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.066023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.066023] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be updated. [ 824.117964] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.118295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.118421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.118929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.119218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.132069] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: IN_PROGRESS for 2s [ 824.280045] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 824.280297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.280488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.280700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.280917] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.281060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.281137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.281309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.281394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.281481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.281583] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.743407] env[65106]: INFO networking_nsxv3.common.synchronization [req-2bb2d1ec-6405-40d0-9caf-88f9766efe5f req-889dc6cf-5e31-4fbc-9355-633e60ae80dc tempest-ListServersNegativeTestJSON-814622823 tempest-ListServersNegativeTestJSON-814622823-project-member] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 824.743407] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 824.743607] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.743726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.744100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.744100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.744375] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.744375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.744375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.744490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.744538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.744643] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.785026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.785319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.992529] env[65106]: INFO networking_nsxv3.common.synchronization [req-dc96daca-c063-4426-a3ef-4c1088717388 req-0dd7a995-7a72-4b3a-8e54-a10449590860 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 824.992529] env[65106]: INFO networking_nsxv3.common.synchronization [req-dc96daca-c063-4426-a3ef-4c1088717388 req-0dd7a995-7a72-4b3a-8e54-a10449590860 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: 801f4d67-386f-4801-8f6a-7817c5da92ef with Priority: HIGHEST for action security_group_members [ 824.992529] env[65106]: INFO networking_nsxv3.common.synchronization [req-dc96daca-c063-4426-a3ef-4c1088717388 req-0dd7a995-7a72-4b3a-8e54-a10449590860 tempest-SecurityGroupsTestJSON-634534121 tempest-SecurityGroupsTestJSON-634534121-project-member] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 824.992529] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 with Priority: HIGHEST for action security_group_members [ 824.993228] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 801f4d67-386f-4801-8f6a-7817c5da92ef with Priority: HIGHEST for action security_group_members [ 824.993473] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGHEST for action security_group_members [ 824.993860] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-143c4b09-e4ef-4609-8ff0-863f1dce9402 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.994145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.994346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.994637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.994898] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.995135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.995284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.995557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.995750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.995936] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('143c4b09-e4ef-4609-8ff0-863f1dce9402',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.996991] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-801f4d67-386f-4801-8f6a-7817c5da92ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.997283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.997455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.997709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.997966] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.998191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.998344] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.998578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.998751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.998922] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('801f4d67-386f-4801-8f6a-7817c5da92ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.999876] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.000131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.001017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.001017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.001017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.001017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.001017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.001017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.001017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.001449] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.246729] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.315902] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: SUCCESS [ 825.316162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.316348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.316633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.316786] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.316906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.316972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.317137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.317217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.317304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.317646] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.319205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.319620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.319909] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.320578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.320649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.320864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.320903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.320992] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.453422] env[65106]: INFO networking_nsxv3.common.synchronization [req-f6eaea9d-bd15-4d92-bc86-cd1eb3a46f77 req-140dab1e-dd14-4fbb-bae2-8c4a7baf1a72 tempest-AttachInterfacesUnderV243Test-1518897395 tempest-AttachInterfacesUnderV243Test-1518897395-project-member] Enqueued Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 825.454360] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19332543-7a24-4c8f-8b80-055c71f06f3d with Priority: HIGHEST for action security_group_members [ 825.455208] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-19332543-7a24-4c8f-8b80-055c71f06f3d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.455313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.503636] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.503882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.503983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.504544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.505922] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.505922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.507724] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.507845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.526622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.527182] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.527338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.527417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.527652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.527753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.527896] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 801f4d67-386f-4801-8f6a-7817c5da92ef is going to be updated. [ 825.529117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.529336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.529461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.529694] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.529804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.529901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.530218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.530308] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.530400] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 is going to be updated. [ 825.531371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.531520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.531618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.531828] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.531948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.532050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.532200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.532309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.532399] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be updated. [ 825.571286] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.571675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.571675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.571675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.571970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.584617] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: IN_PROGRESS for 2s [ 825.586703] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.586894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.586937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.587257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.587495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.589610] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.589754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.589795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.590243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.590491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.600928] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: IN_PROGRESS for 2s [ 825.601890] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 801f4d67-386f-4801-8f6a-7817c5da92ef in Status: IN_PROGRESS for 2s [ 825.749439] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.822021] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.822952] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.143584] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52a63c62-ab68-4afc-b239-81d4bb46173e in Status: SUCCESS [ 826.145186] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e deletion is rescheduled due to dependency. [ 826.145186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.252265] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.252418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.252461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.252657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.252841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.252841] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 826.291693] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.291847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.291946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.292452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.292545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.309287] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 826.322786] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 19332543-7a24-4c8f-8b80-055c71f06f3d: rpc.has_security_group_logging(os_id): False [ 826.327744] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.352854] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.353023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.353023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.353208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.390986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.391380] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.391717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.391717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.391835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.391902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.392045] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d is going to be updated. [ 826.460065] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.460270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.460270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.460502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.460648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.485143] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: IN_PROGRESS for 2s [ 826.832505] env[65106]: INFO networking_nsxv3.common.synchronization [None req-86fc35d9-e794-4939-bade-c7eb84db9858 None None] Enqueued Resource ID: 42e7ddd0-fd5d-4ef8-b77e-362870702fe8 with Priority: HIGHEST for action port [ 826.832505] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.832505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.832749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.832749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.832843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.832941] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d is going to be updated. [ 826.835401] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42e7ddd0-fd5d-4ef8-b77e-362870702fe8 with Priority: HIGHEST for action port [ 826.835401] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-42e7ddd0-fd5d-4ef8-b77e-362870702fe8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.835401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42e7ddd0-fd5d-4ef8-b77e-362870702fe8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.835401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42e7ddd0-fd5d-4ef8-b77e-362870702fe8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.835401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42e7ddd0-fd5d-4ef8-b77e-362870702fe8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.835401] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42e7ddd0-fd5d-4ef8-b77e-362870702fe8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.867678] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.867860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.867949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.868207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.868345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.879725] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: IN_PROGRESS for 2s [ 827.338347] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42e7ddd0-fd5d-4ef8-b77e-362870702fe8 [ 827.338645] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.338876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.338876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.339035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.339105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.339223] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42e7ddd0-fd5d-4ef8-b77e-362870702fe8 already deleted. [ 827.339368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42e7ddd0-fd5d-4ef8-b77e-362870702fe8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.595360] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 in Status: SUCCESS [ 827.595623] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 deletion is rescheduled due to dependency. [ 827.595623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.614011] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 801f4d67-386f-4801-8f6a-7817c5da92ef in Status: SUCCESS [ 827.614011] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 801f4d67-386f-4801-8f6a-7817c5da92ef deletion is rescheduled due to dependency. [ 827.614011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-801f4d67-386f-4801-8f6a-7817c5da92ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.614011] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 in Status: SUCCESS [ 827.614011] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 143c4b09-e4ef-4609-8ff0-863f1dce9402 deletion is rescheduled due to dependency. [ 827.614011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-143c4b09-e4ef-4609-8ff0-863f1dce9402" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.321081] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 828.321206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.323458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.323458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.323458] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.323637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.323637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.323806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.323931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.323965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.324195] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.324338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.324397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.324572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.324731] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.324826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.324882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.325062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.325142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.325221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.325306] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.499350] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: SUCCESS [ 828.499775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.499775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.499929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.500037] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.827330] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89b2fdad-d445-45cc-854d-bad422551520: rpc.has_security_group_logging(os_id): False [ 828.848219] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.848417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.848778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.848778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.848888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.849091] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.849190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.849278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.849847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.849847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.849847] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.850083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.850083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.853096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.853301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.854302] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.854302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.854302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.854302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.854302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.854302] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 828.889442] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 19332543-7a24-4c8f-8b80-055c71f06f3d in Status: SUCCESS [ 828.889912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.890208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.890526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.891409] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.891409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.891409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.891409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.891409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.891409] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.925023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.925183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.925233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.925445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.925780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.943023] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 829.027801] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.027975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.027975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.029069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.029069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.029069] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d is going to be deleted. [ 829.087751] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.087894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.087971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.088195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.088296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.088441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.175570] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d7b00f6b-e207-46d9-935e-8315816b30a1 None None] Enqueued Resource ID: dbe962fd-72b2-47c4-bd78-cf4c4e9ead28 with Priority: HIGHEST for action port [ 829.175849] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbe962fd-72b2-47c4-bd78-cf4c4e9ead28 with Priority: HIGHEST for action port [ 829.175997] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbe962fd-72b2-47c4-bd78-cf4c4e9ead28 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.176263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbe962fd-72b2-47c4-bd78-cf4c4e9ead28" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.176263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbe962fd-72b2-47c4-bd78-cf4c4e9ead28" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.176510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbe962fd-72b2-47c4-bd78-cf4c4e9ead28" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.176510] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbe962fd-72b2-47c4-bd78-cf4c4e9ead28',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.396061] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.396061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.396061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.396061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.396061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.396061] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.396061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.396061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.396061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.396061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.396491] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d is going to be deleted. [ 829.428409] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.428589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.428661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.428909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.428997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.429075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.429237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.429387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.429554] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.429650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.429710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.429854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.429928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.431140] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('19332543-7a24-4c8f-8b80-055c71f06f3d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.683059] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbe962fd-72b2-47c4-bd78-cf4c4e9ead28 [ 829.683487] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.683487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.683668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.683752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.683863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.683968] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbe962fd-72b2-47c4-bd78-cf4c4e9ead28 already deleted. [ 829.684063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbe962fd-72b2-47c4-bd78-cf4c4e9ead28" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.935597] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.935597] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.935597] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 19332543-7a24-4c8f-8b80-055c71f06f3d already deleted. [ 829.935597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-19332543-7a24-4c8f-8b80-055c71f06f3d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.346053] env[65106]: INFO networking_nsxv3.common.synchronization [None req-c71edc2c-9188-4c2c-8205-a90c30d4abd7 None None] Enqueued Resource ID: 6ad28d03-c655-4e03-87af-4a15fbf3e62b with Priority: HIGHEST for action port [ 830.346499] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ad28d03-c655-4e03-87af-4a15fbf3e62b with Priority: HIGHEST for action port [ 830.346800] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ad28d03-c655-4e03-87af-4a15fbf3e62b taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.346944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ad28d03-c655-4e03-87af-4a15fbf3e62b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.346975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ad28d03-c655-4e03-87af-4a15fbf3e62b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.347240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ad28d03-c655-4e03-87af-4a15fbf3e62b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.347322] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ad28d03-c655-4e03-87af-4a15fbf3e62b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.850217] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ad28d03-c655-4e03-87af-4a15fbf3e62b [ 830.850519] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.850649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.850718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.850989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.851211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.851346] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ad28d03-c655-4e03-87af-4a15fbf3e62b already deleted. [ 830.851400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ad28d03-c655-4e03-87af-4a15fbf3e62b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.958168] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 830.958168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.958168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.958168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.958168] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.460108] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.460108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.460108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.460561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.460561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.460561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.460935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.460935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.460935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.460935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.461110] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.568735] env[65106]: INFO networking_nsxv3.common.synchronization [req-6301828b-9639-4a65-9eb3-3b9a808356ca req-62098874-ed0c-41f5-8f55-6e145de5d89d tempest-ServerRescueTestJSON-731943944 tempest-ServerRescueTestJSON-731943944-project-member] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 831.569290] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 831.569595] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.569713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.569804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.570025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.570549] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.570636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.570688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.571542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.571542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.571542] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.966427] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.966731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.966786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.967609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.967609] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.967609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.967609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.967609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.967865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.967865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.968016] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.968284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.968284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.968434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.968536] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.968636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.968763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.968898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.969354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.969354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.969354] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.074597] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.141890] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-981 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.142300] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-981" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.142511] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-981" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.142886] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-981" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.143327] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.143563] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.143668] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.143969] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.144332] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.144636] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.145157] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 832.145157] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 832.145157] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 832.145157] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 832.145335] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 832.145439] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 832.149541] env[65106]: INFO networking_nsxv3.common.synchronization [None req-40c9c0fa-2fed-4aa5-b750-539d2908c1df None None] Enqueued Resource ID: 334447c2-15c0-4768-bef7-430c8cc1d8b5 with Priority: HIGHEST for action port [ 832.149831] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334447c2-15c0-4768-bef7-430c8cc1d8b5 with Priority: HIGHEST for action port [ 832.150160] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-334447c2-15c0-4768-bef7-430c8cc1d8b5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.150279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334447c2-15c0-4768-bef7-430c8cc1d8b5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.150337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334447c2-15c0-4768-bef7-430c8cc1d8b5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.150591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334447c2-15c0-4768-bef7-430c8cc1d8b5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.150741] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334447c2-15c0-4768-bef7-430c8cc1d8b5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.169467] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 832.169844] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 832.169844] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 832.170366] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-981" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.170366] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-145b0b89-0c47-4e6a-848f-48e84dd35a1f taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.171179] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-145b0b89-0c47-4e6a-848f-48e84dd35a1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.171179] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-145b0b89-0c47-4e6a-848f-48e84dd35a1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.171179] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-145b0b89-0c47-4e6a-848f-48e84dd35a1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.171179] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('145b0b89-0c47-4e6a-848f-48e84dd35a1f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.471168] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 89b2fdad-d445-45cc-854d-bad422551520: rpc.has_security_group_logging(os_id): False [ 832.490487] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.490651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.490726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.490937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.491042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.491317] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.491425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.491532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.491639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.491714] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.491955] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.492033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.492073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.492202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.492276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.492461] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.492542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.492848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.492848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.492848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.493036] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 832.554408] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.554627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.554746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.554985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.555186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.572485] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 832.577947] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.653392] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 334447c2-15c0-4768-bef7-430c8cc1d8b5 [ 832.653637] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.653777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.653839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.654083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.654185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.654313] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:334447c2-15c0-4768-bef7-430c8cc1d8b5 already deleted. [ 832.654595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334447c2-15c0-4768-bef7-430c8cc1d8b5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.674725] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.674987] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.675134] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.675662] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.675868] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.675988] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 145b0b89-0c47-4e6a-848f-48e84dd35a1f not found, creating... [ 832.676284] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.676451] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.676568] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.677128] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.677304] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.677624] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.677785] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.677901] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.678231] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.678331] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.678448] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 145b0b89-0c47-4e6a-848f-48e84dd35a1f is going to be created. [ 832.690541] env[65106]: INFO networking_nsxv3.common.synchronization [None req-19da9ff0-7c5a-4e21-9ed2-9aadd079c323 None None] Enqueued Resource ID: 08dc5a67-23bc-4d6c-94fa-713b3d6153d1 with Priority: HIGHEST for action port [ 832.691115] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08dc5a67-23bc-4d6c-94fa-713b3d6153d1 with Priority: HIGHEST for action port [ 832.691419] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-08dc5a67-23bc-4d6c-94fa-713b3d6153d1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.691560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08dc5a67-23bc-4d6c-94fa-713b3d6153d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.691619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08dc5a67-23bc-4d6c-94fa-713b3d6153d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.692967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08dc5a67-23bc-4d6c-94fa-713b3d6153d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.692967] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08dc5a67-23bc-4d6c-94fa-713b3d6153d1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.718992] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.719248] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.719372] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.720344] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.720344] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.720344] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-145b0b89-0c47-4e6a-848f-48e84dd35a1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.080556] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.080876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.080876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.081215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.081215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.081332] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be updated. [ 833.148414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.148552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.148625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.148859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.149046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.162580] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: IN_PROGRESS for 2s [ 833.197374] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08dc5a67-23bc-4d6c-94fa-713b3d6153d1 [ 833.197374] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.197374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.197374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.197614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.197614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.197728] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08dc5a67-23bc-4d6c-94fa-713b3d6153d1 already deleted. [ 833.197894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08dc5a67-23bc-4d6c-94fa-713b3d6153d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.546779] env[65106]: INFO networking_nsxv3.common.synchronization [req-6301828b-9639-4a65-9eb3-3b9a808356ca req-05286a03-e67a-43d9-8ae7-8f011a785ba1 service nova] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_rules [ 833.546949] env[65106]: INFO networking_nsxv3.common.synchronization [req-6301828b-9639-4a65-9eb3-3b9a808356ca req-05286a03-e67a-43d9-8ae7-8f011a785ba1 service nova] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 833.547129] env[65106]: INFO networking_nsxv3.common.synchronization [req-6301828b-9639-4a65-9eb3-3b9a808356ca req-05286a03-e67a-43d9-8ae7-8f011a785ba1 service nova] Enqueued Resource ID: 145b0b89-0c47-4e6a-848f-48e84dd35a1f with Priority: HIGHEST for action port [ 833.547670] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_rules [ 833.547809] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 833.547964] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145b0b89-0c47-4e6a-848f-48e84dd35a1f with Priority: HIGHEST for action port [ 833.548260] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.548455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.548554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.548810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.548933] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.549876] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.549966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.550590] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-145b0b89-0c47-4e6a-848f-48e84dd35a1f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.550765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-145b0b89-0c47-4e6a-848f-48e84dd35a1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.550801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-145b0b89-0c47-4e6a-848f-48e84dd35a1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.553802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-145b0b89-0c47-4e6a-848f-48e84dd35a1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.553802] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('145b0b89-0c47-4e6a-848f-48e84dd35a1f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.053679] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.053679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.056239] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 145b0b89-0c47-4e6a-848f-48e84dd35a1f with status ACTIVE [ 834.056322] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.056467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.056569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.058083] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.058083] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.058083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.058697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.058697] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 145b0b89-0c47-4e6a-848f-48e84dd35a1f is going to be updated. [ 834.084232] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.084584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.084584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.085676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.085676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.085676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-145b0b89-0c47-4e6a-848f-48e84dd35a1f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.589709] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 834.590046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.822118] env[65106]: INFO networking_nsxv3.common.synchronization [None req-e227a1ff-1a37-427a-b87b-bd5fba8990cf None None] Enqueued Resource ID: 025dbb88-0d7a-43ee-966d-2cdbd497fae0 with Priority: HIGHEST for action port [ 834.822737] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 025dbb88-0d7a-43ee-966d-2cdbd497fae0 with Priority: HIGHEST for action port [ 834.823260] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-025dbb88-0d7a-43ee-966d-2cdbd497fae0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.823574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-025dbb88-0d7a-43ee-966d-2cdbd497fae0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.823574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-025dbb88-0d7a-43ee-966d-2cdbd497fae0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.823887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-025dbb88-0d7a-43ee-966d-2cdbd497fae0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.823951] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('025dbb88-0d7a-43ee-966d-2cdbd497fae0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.173692] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: SUCCESS [ 835.174085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.174085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.174330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.174495] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.174608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.174671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.174819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.174897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.175091] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.330399] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 025dbb88-0d7a-43ee-966d-2cdbd497fae0 [ 835.330700] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.330978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.330978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.331500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.331500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.331500] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:025dbb88-0d7a-43ee-966d-2cdbd497fae0 already deleted. [ 835.331652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-025dbb88-0d7a-43ee-966d-2cdbd497fae0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.677196] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.938679] env[65106]: INFO networking_nsxv3.common.synchronization [req-6c2256e9-b254-48f3-9d7c-e9bbc5eea702 req-4f6b0f1c-712d-4c9c-852e-a64570cf19ff tempest-ListImageFiltersTestJSON-1907947682 tempest-ListImageFiltersTestJSON-1907947682-project-member] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 835.939362] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGHEST for action security_group_members [ 835.939782] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.939875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.939943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.940190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.940341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.940494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.940577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.940754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.940839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.940935] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.180343] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.444602] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.444762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.444851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.445065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.445168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.446178] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.446369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.446446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.446624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.446706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.446798] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be updated. [ 836.484898] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.484898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.484898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.485582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.485826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.499245] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: IN_PROGRESS for 2s [ 836.685680] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.686120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.686120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.686380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.686479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.686595] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be updated. [ 836.726239] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.726399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.726469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.726685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.726871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.745182] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: IN_PROGRESS for 2s [ 837.406046] env[65106]: INFO networking_nsxv3.common.synchronization [req-cd215094-3d10-4b7d-9101-791ce3c573de req-c5143cb1-0a64-43fe-b57d-fe8db27860b2 tempest-ServerMetadataNegativeTestJSON-1845275320 tempest-ServerMetadataNegativeTestJSON-1845275320-project-member] Enqueued Resource ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a with Priority: HIGHEST for action security_group_members [ 837.406601] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a with Priority: HIGHEST for action security_group_members [ 837.412362] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.412951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.412951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.412951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.413104] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.413156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.413232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.413430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.413544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.413658] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bfd09ac0-101c-4f4a-a6a9-9a67108ff64a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.917427] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.917815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.917916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.918305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.918434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.918726] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.918839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.918919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.919084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.919165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.919262] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a is going to be updated. [ 837.952331] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.952610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.952610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.952693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.952914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.962696] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a in Status: IN_PROGRESS for 2s [ 838.510213] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a in Status: SUCCESS [ 838.510619] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a deletion is rescheduled due to dependency. [ 838.510790] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.754410] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: SUCCESS [ 838.754673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.754842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.755085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.755325] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.755453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.755591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.755684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.755759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.755841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.755976] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.258220] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.258414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.258508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.259463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.259463] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.259463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.259463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.259463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.259463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.259463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.259463] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.260065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.260065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.260065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.260065] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.260414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.260490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.260656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.260737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.260819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.260909] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.607600] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b70848c6-e60d-4fb7-9008-084cfa3e2d21 None None] Enqueued Resource ID: 9487f5a3-9571-4a05-969f-39ea8ecd2a97 with Priority: HIGHEST for action port [ 839.608258] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9487f5a3-9571-4a05-969f-39ea8ecd2a97 with Priority: HIGHEST for action port [ 839.608642] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-9487f5a3-9571-4a05-969f-39ea8ecd2a97 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.608801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9487f5a3-9571-4a05-969f-39ea8ecd2a97" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.608910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9487f5a3-9571-4a05-969f-39ea8ecd2a97" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.611505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9487f5a3-9571-4a05-969f-39ea8ecd2a97" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.611625] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9487f5a3-9571-4a05-969f-39ea8ecd2a97',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.762859] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 108c3320-1bbb-4cb7-a30a-c66ddca2d037: rpc.has_security_group_logging(os_id): False [ 839.782321] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.782469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.783047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.783047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.783047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.783047] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.783283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.783283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.783445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.783445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.783625] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.783717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.783778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.783917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.783991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.784176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.784267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.784335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.784520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.784600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.784686] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be updated. [ 839.847415] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.847621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.847621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.847869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.848059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.862742] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: IN_PROGRESS for 2s [ 839.974966] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a in Status: SUCCESS [ 839.975156] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bfd09ac0-101c-4f4a-a6a9-9a67108ff64a deletion is rescheduled due to dependency. [ 839.975276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bfd09ac0-101c-4f4a-a6a9-9a67108ff64a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.115968] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9487f5a3-9571-4a05-969f-39ea8ecd2a97 [ 840.116337] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.116840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.116840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.117176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.117271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.117392] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9487f5a3-9571-4a05-969f-39ea8ecd2a97 already deleted. [ 840.117557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9487f5a3-9571-4a05-969f-39ea8ecd2a97" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.878784] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: SUCCESS [ 841.879222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.904145] env[65106]: INFO networking_nsxv3.common.synchronization [None req-89d7767f-6a6e-45f8-80f0-27a092f8970d None None] Enqueued Resource ID: b88c1f0f-7004-4d03-ab95-8f38c6adc029 with Priority: HIGHEST for action port [ 841.905212] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b88c1f0f-7004-4d03-ab95-8f38c6adc029 with Priority: HIGHEST for action port [ 841.905212] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-b88c1f0f-7004-4d03-ab95-8f38c6adc029 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.905212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b88c1f0f-7004-4d03-ab95-8f38c6adc029" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.906527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b88c1f0f-7004-4d03-ab95-8f38c6adc029" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.906527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b88c1f0f-7004-4d03-ab95-8f38c6adc029" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.906527] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b88c1f0f-7004-4d03-ab95-8f38c6adc029',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.409901] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b88c1f0f-7004-4d03-ab95-8f38c6adc029 [ 842.409901] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.410107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.410107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.410290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.410494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.410671] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b88c1f0f-7004-4d03-ab95-8f38c6adc029 already deleted. [ 842.410761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b88c1f0f-7004-4d03-ab95-8f38c6adc029" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.259595] env[65106]: INFO networking_nsxv3.common.synchronization [req-a9b24690-ac6d-4bb8-a1f6-594c7b9c8586 req-9161a45f-dfd6-4b5c-8f8d-759bab43d350 tempest-ServerGroupTestJSON-348849452 tempest-ServerGroupTestJSON-348849452-project-member] Enqueued Resource ID: 7ea85039-86ee-4308-91e9-eb31b591a98a with Priority: HIGHEST for action security_group_members [ 845.260557] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea85039-86ee-4308-91e9-eb31b591a98a with Priority: HIGHEST for action security_group_members [ 845.260884] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea85039-86ee-4308-91e9-eb31b591a98a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.261571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.261571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.261939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.262257] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.262257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.262257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.262477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.262477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.262563] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea85039-86ee-4308-91e9-eb31b591a98a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.616695] env[65106]: INFO networking_nsxv3.common.synchronization [req-7f497827-813d-4076-b724-857b341eed80 req-c14cb432-194e-4597-8421-5fcf644c7a55 tempest-VolumesAssistedSnapshotsTest-469682830 tempest-VolumesAssistedSnapshotsTest-469682830-project-member] Enqueued Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_members [ 845.617284] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 with Priority: HIGHEST for action security_group_members [ 845.617641] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.617810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.617810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.617969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.618132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.618575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.618653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.618806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.619592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.619592] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac9de4d4-ec9d-4ad4-ad6f-65eee9862501',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.653994] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-35 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.655226] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-35" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.655226] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-35" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.655538] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-35" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.655851] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.655998] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.656157] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.656429] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.656611] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.656922] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.657304] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 845.657304] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 845.657485] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 845.657697] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 845.657870] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 845.658095] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 845.678425] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 845.678539] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 845.678706] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 845.678888] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-35" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.679236] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-4e4fd923-bafe-479f-8dd1-0c3324f5b892 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.679410] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-4e4fd923-bafe-479f-8dd1-0c3324f5b892" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.679527] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-4e4fd923-bafe-479f-8dd1-0c3324f5b892" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.679927] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-4e4fd923-bafe-479f-8dd1-0c3324f5b892" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.680095] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4fd923-bafe-479f-8dd1-0c3324f5b892',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.764932] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.765174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.765284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.765523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.765618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.765894] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.766033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.766152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.766277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.766382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.766475] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea85039-86ee-4308-91e9-eb31b591a98a already deleted. [ 845.766587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.120870] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.121052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.121102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.121530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.143915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.144135] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.144300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.144349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.144541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.144648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.144708] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 is going to be updated. [ 846.178119] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.178273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.178345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.178568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.178716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.181959] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.182192] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.182320] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.182540] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.182682] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.182834] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 4e4fd923-bafe-479f-8dd1-0c3324f5b892 not found, creating... [ 846.183224] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.183419] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.183511] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.183734] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.183872] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.184186] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.184344] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.184426] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.184685] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.184886] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.184960] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 4e4fd923-bafe-479f-8dd1-0c3324f5b892 is going to be created. [ 846.188548] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 in Status: IN_PROGRESS for 2s [ 846.207180] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.207418] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.207542] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.207812] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.208049] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.208279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-4e4fd923-bafe-479f-8dd1-0c3324f5b892" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.936145] env[65106]: INFO networking_nsxv3.common.synchronization [req-a9b24690-ac6d-4bb8-a1f6-594c7b9c8586 req-f77380de-1a77-4d52-a3e1-52e117e0c1c4 service nova] Enqueued Resource ID: 7ea85039-86ee-4308-91e9-eb31b591a98a with Priority: HIGHEST for action security_group_rules [ 846.936145] env[65106]: INFO networking_nsxv3.common.synchronization [req-a9b24690-ac6d-4bb8-a1f6-594c7b9c8586 req-f77380de-1a77-4d52-a3e1-52e117e0c1c4 service nova] Enqueued Resource ID: 7ea85039-86ee-4308-91e9-eb31b591a98a with Priority: HIGHEST for action security_group_members [ 846.936145] env[65106]: INFO networking_nsxv3.common.synchronization [req-a9b24690-ac6d-4bb8-a1f6-594c7b9c8586 req-f77380de-1a77-4d52-a3e1-52e117e0c1c4 service nova] Enqueued Resource ID: 4e4fd923-bafe-479f-8dd1-0c3324f5b892 with Priority: HIGHEST for action port [ 846.936145] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea85039-86ee-4308-91e9-eb31b591a98a with Priority: HIGHEST for action security_group_rules [ 846.936145] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea85039-86ee-4308-91e9-eb31b591a98a with Priority: HIGHEST for action security_group_members [ 846.936145] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e4fd923-bafe-479f-8dd1-0c3324f5b892 with Priority: HIGHEST for action port [ 846.936760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ea85039-86ee-4308-91e9-eb31b591a98a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.936760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.936760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.936760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.936924] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ea85039-86ee-4308-91e9-eb31b591a98a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.937777] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea85039-86ee-4308-91e9-eb31b591a98a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.937882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.937931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.938097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.938239] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.938347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.938385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.938513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.938592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.938698] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea85039-86ee-4308-91e9-eb31b591a98a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.940691] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e4fd923-bafe-479f-8dd1-0c3324f5b892 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.940850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e4fd923-bafe-479f-8dd1-0c3324f5b892" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.940955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e4fd923-bafe-479f-8dd1-0c3324f5b892" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.941154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e4fd923-bafe-479f-8dd1-0c3324f5b892" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.941263] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e4fd923-bafe-479f-8dd1-0c3324f5b892',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.018151] env[65106]: INFO networking_nsxv3.common.synchronization [req-d235bad4-dbbf-46d5-9b35-b8e2432b3e0c req-30701894-bb8f-44e6-980b-149310d18404 tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 847.018704] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 847.019318] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.019448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.019515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.019725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.019871] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.019969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.023285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.023602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.023691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.024081] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.390167] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.390341] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.390446] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.392522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.392522] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.392522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.392522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.392522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.392740] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.392870] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.392978] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.393093] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.393194] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.393300] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.393452] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.393584] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.415621] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.415621] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 847.416269] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.416592] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.416928] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-5f5b4282-4f81-4253-b084-661576768e03 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.417119] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-5f5b4282-4f81-4253-b084-661576768e03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.417276] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-5f5b4282-4f81-4253-b084-661576768e03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.417534] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-5f5b4282-4f81-4253-b084-661576768e03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.417671] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f5b4282-4f81-4253-b084-661576768e03',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.443181] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ea85039-86ee-4308-91e9-eb31b591a98a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.446077] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea85039-86ee-4308-91e9-eb31b591a98a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.446207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.446778] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e4fd923-bafe-479f-8dd1-0c3324f5b892 with status ACTIVE [ 847.446950] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.447076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.447141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.447332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.447502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.447572] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.447666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.447725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.447867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.447940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.449015] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.449015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.449015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.449015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.449015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.449015] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e4fd923-bafe-479f-8dd1-0c3324f5b892 is going to be updated. [ 847.473463] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.473734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.473789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.474007] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.474161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.474318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e4fd923-bafe-479f-8dd1-0c3324f5b892" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.526097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.526259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.526340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.526521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.527062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.527062] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.527062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.527062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.527062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.527363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.527363] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 847.557622] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.557838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.557838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.558242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.558242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.584266] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 847.922064] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.922064] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.922432] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.922650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.922854] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.923021] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 5f5b4282-4f81-4253-b084-661576768e03 not found, creating... [ 847.923306] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.923546] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.923677] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.923922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.924068] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.924394] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.924614] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.924733] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.924946] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.925090] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.925261] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 5f5b4282-4f81-4253-b084-661576768e03 is going to be created. [ 847.947510] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ea85039-86ee-4308-91e9-eb31b591a98a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.949816] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.950037] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.950157] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.950836] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.950836] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.950996] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-5f5b4282-4f81-4253-b084-661576768e03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.201107] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 in Status: SUCCESS [ 848.201107] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac9de4d4-ec9d-4ad4-ad6f-65eee9862501 deletion is rescheduled due to dependency. [ 848.201107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac9de4d4-ec9d-4ad4-ad6f-65eee9862501" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.453089] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.453267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.453348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.453637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.453727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.453894] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea85039-86ee-4308-91e9-eb31b591a98a is going to be created. [ 848.478050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.478291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.478291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.478449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.478637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.490200] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea85039-86ee-4308-91e9-eb31b591a98a in Status: UNINITIALIZED for 2s [ 848.700641] env[65106]: INFO networking_nsxv3.common.synchronization [req-d235bad4-dbbf-46d5-9b35-b8e2432b3e0c req-e081de90-4709-4ed0-abfa-b532be5da6ac service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 848.701532] env[65106]: INFO networking_nsxv3.common.synchronization [req-d235bad4-dbbf-46d5-9b35-b8e2432b3e0c req-e081de90-4709-4ed0-abfa-b532be5da6ac service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 848.701532] env[65106]: INFO networking_nsxv3.common.synchronization [req-d235bad4-dbbf-46d5-9b35-b8e2432b3e0c req-e081de90-4709-4ed0-abfa-b532be5da6ac service nova] Enqueued Resource ID: 5f5b4282-4f81-4253-b084-661576768e03 with Priority: HIGHEST for action port [ 848.701664] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 848.701701] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 848.702415] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f5b4282-4f81-4253-b084-661576768e03 with Priority: HIGHEST for action port [ 848.703388] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.704718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.704718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.704718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.704718] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.704963] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.704963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.705126] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f5b4282-4f81-4253-b084-661576768e03 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.705204] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f5b4282-4f81-4253-b084-661576768e03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.705272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f5b4282-4f81-4253-b084-661576768e03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.705904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f5b4282-4f81-4253-b084-661576768e03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.706023] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f5b4282-4f81-4253-b084-661576768e03',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.209874] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f5b4282-4f81-4253-b084-661576768e03 with status ACTIVE [ 849.210408] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.210408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.210408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.210658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.210658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.210797] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.210886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.210941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.211085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.211171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.211443] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.211581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.211581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.211704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.211838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.211911] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f5b4282-4f81-4253-b084-661576768e03 is going to be updated. [ 849.213124] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.213445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.253747] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.253747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.253747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.253747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.253747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.253747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f5b4282-4f81-4253-b084-661576768e03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.594871] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 849.595096] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 849.595223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.595491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.595722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.595909] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.596044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.596152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.596258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.596337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.596435] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.098374] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.502047] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea85039-86ee-4308-91e9-eb31b591a98a in Status: SUCCESS [ 850.502047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.502047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.502047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.502047] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.502593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.502593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.502593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.502593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.502593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.502771] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ea85039-86ee-4308-91e9-eb31b591a98a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.600441] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.004916] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea85039-86ee-4308-91e9-eb31b591a98a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.005922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.005922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.005922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.005922] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.005922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.005922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.005922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.005922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.006304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.006304] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea85039-86ee-4308-91e9-eb31b591a98a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.006304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.006304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.006496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.006641] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.006735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.006794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.006931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.007067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.007107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.007181] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ea85039-86ee-4308-91e9-eb31b591a98a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.103160] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.103442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.103442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.103746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.103883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.103958] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 851.135405] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.135689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.135755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.136063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.136268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.146703] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 851.510562] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ea85039-86ee-4308-91e9-eb31b591a98a: rpc.has_security_group_logging(os_id): False [ 851.535807] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.535949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.536030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.536251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.536340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.536531] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.536627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.536688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.536831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.536909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.537124] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.537220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.537281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.537420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.537495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.537721] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.537784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.537821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.537938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.538658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.539127] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ea85039-86ee-4308-91e9-eb31b591a98a is going to be created. [ 851.615030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.615030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.615030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.615030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.615030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.634859] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea85039-86ee-4308-91e9-eb31b591a98a in Status: IN_PROGRESS for 2s [ 853.158171] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 853.159019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.159019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.159219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.159456] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.159575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.159639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.159806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.159883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.159966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.160071] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.648723] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ea85039-86ee-4308-91e9-eb31b591a98a in Status: SUCCESS [ 853.648943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.663296] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.664085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.664085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.664085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.664085] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.664085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.664341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.664341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.664341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.664523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.664605] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.664744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.664744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.664904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.665037] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.665124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.665182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.665314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.665387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.665466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.665557] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.702470] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 853.702570] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 854.167759] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00fc8ecc-2b12-478d-8a50-43a7183605bc: rpc.has_security_group_logging(os_id): False [ 854.187998] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.187998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.187998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.188272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.188312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.188498] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.188608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.188671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.188820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.188898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.189181] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.189307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.189370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.189509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.189581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.189851] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.189851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.189969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.190037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.190642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.191228] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 854.258804] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.259047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.259176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.259496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.259735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.279703] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 855.822155] env[65106]: INFO networking_nsxv3.common.synchronization [None req-6d438a1f-f2e5-418b-87e0-140c0799502d None None] Enqueued Resource ID: 0cad3bb0-44db-45e8-b8b7-0226bc925432 with Priority: HIGHEST for action port [ 855.823042] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0cad3bb0-44db-45e8-b8b7-0226bc925432 with Priority: HIGHEST for action port [ 855.823397] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0cad3bb0-44db-45e8-b8b7-0226bc925432 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.823622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0cad3bb0-44db-45e8-b8b7-0226bc925432" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.823728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0cad3bb0-44db-45e8-b8b7-0226bc925432" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.824064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0cad3bb0-44db-45e8-b8b7-0226bc925432" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.824165] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0cad3bb0-44db-45e8-b8b7-0226bc925432',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.155385] env[65106]: INFO networking_nsxv3.common.synchronization [req-67f4b09e-0b33-4944-81d3-300657a9c9d8 req-f11631c9-0135-4760-a073-d4c70a1cb313 tempest-ServersAdminTestJSON-1615839610 tempest-ServersAdminTestJSON-1615839610-project-member] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 856.155968] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 856.156321] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.156413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.156541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.156683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.156921] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.156921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.157062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.157646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.157756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.157890] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.302698] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 856.302949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.326971] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0cad3bb0-44db-45e8-b8b7-0226bc925432 [ 856.327241] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.327386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.327454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.327671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.327756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.327848] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0cad3bb0-44db-45e8-b8b7-0226bc925432 already deleted. [ 856.327929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0cad3bb0-44db-45e8-b8b7-0226bc925432" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.662044] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.169484] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.672405] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.672724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.672724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.673019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.673019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.673113] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 857.733305] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.733436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.733575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.733745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.733889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.745323] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 858.312245] env[65106]: INFO networking_nsxv3.common.synchronization [req-3a1cb248-8cd9-4bd0-a7d6-9419f2ae2532 req-13ae57f5-bbe1-4ae0-86d9-49cef6acafd1 tempest-ServerGroupTestJSON-348849452 tempest-ServerGroupTestJSON-348849452-project-member] Enqueued Resource ID: 7ea85039-86ee-4308-91e9-eb31b591a98a with Priority: HIGHEST for action security_group_members [ 858.312692] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ea85039-86ee-4308-91e9-eb31b591a98a with Priority: HIGHEST for action security_group_members [ 858.314319] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ea85039-86ee-4308-91e9-eb31b591a98a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.314717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.314798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.315019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.315202] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.315305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.315361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.315513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.315599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.315695] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ea85039-86ee-4308-91e9-eb31b591a98a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.392129] env[65106]: INFO networking_nsxv3.common.synchronization [None req-2aa4fe84-88f5-4fa9-9a48-902af9eca94e None None] Enqueued Resource ID: b612a3d4-b366-4f96-9970-43c827b66f7d with Priority: HIGHEST for action port [ 858.392717] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b612a3d4-b366-4f96-9970-43c827b66f7d with Priority: HIGHEST for action port [ 858.393138] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-b612a3d4-b366-4f96-9970-43c827b66f7d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.393256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b612a3d4-b366-4f96-9970-43c827b66f7d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.393310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b612a3d4-b366-4f96-9970-43c827b66f7d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.393844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b612a3d4-b366-4f96-9970-43c827b66f7d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.393844] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b612a3d4-b366-4f96-9970-43c827b66f7d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.818243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.818466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.818527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.818762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.818859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.819090] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.819191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.819252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.819404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.819478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.819561] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea85039-86ee-4308-91e9-eb31b591a98a is going to be updated. [ 858.844151] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.844309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.844360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.844676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.844859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.853557] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea85039-86ee-4308-91e9-eb31b591a98a in Status: IN_PROGRESS for 2s [ 858.898257] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b612a3d4-b366-4f96-9970-43c827b66f7d [ 858.898257] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.898257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.898257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.898447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.898550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.898670] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b612a3d4-b366-4f96-9970-43c827b66f7d already deleted. [ 858.898715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b612a3d4-b366-4f96-9970-43c827b66f7d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.755253] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 859.755911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.838232] env[65106]: INFO networking_nsxv3.common.synchronization [req-2bba9edc-eb4c-4350-9a09-2685393a4342 req-165ecd38-83cf-42b8-9e28-b11a473278e2 tempest-ServerRescueTestJSON-731943944 tempest-ServerRescueTestJSON-731943944-project-member] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 859.838826] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 859.839457] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.839457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.839457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.839708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.839708] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.839847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.839847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.839954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.840022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.840161] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.342091] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.844094] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.867442] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ea85039-86ee-4308-91e9-eb31b591a98a in Status: SUCCESS [ 860.867442] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ea85039-86ee-4308-91e9-eb31b591a98a deletion is rescheduled due to dependency. [ 860.867442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ea85039-86ee-4308-91e9-eb31b591a98a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.347229] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.347392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.347454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.347674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.347834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.347875] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be updated. [ 861.379930] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.380095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.380095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.380293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.380877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.393527] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: IN_PROGRESS for 2s [ 863.412553] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: SUCCESS [ 863.412849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.884577] env[65106]: INFO networking_nsxv3.common.synchronization [None req-69d88172-10b8-4dc7-a976-6b149a3ce35e None None] Enqueued Resource ID: 15462e8f-070a-49ed-aefb-6331f61044f6 with Priority: HIGHEST for action port [ 863.884859] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15462e8f-070a-49ed-aefb-6331f61044f6 with Priority: HIGHEST for action port [ 863.885430] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-15462e8f-070a-49ed-aefb-6331f61044f6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.885555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15462e8f-070a-49ed-aefb-6331f61044f6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.885618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15462e8f-070a-49ed-aefb-6331f61044f6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.886500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15462e8f-070a-49ed-aefb-6331f61044f6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.886642] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15462e8f-070a-49ed-aefb-6331f61044f6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.388951] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 15462e8f-070a-49ed-aefb-6331f61044f6 [ 864.389284] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.389438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.389510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.389725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.390610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.390610] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:15462e8f-070a-49ed-aefb-6331f61044f6 already deleted. [ 864.390610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15462e8f-070a-49ed-aefb-6331f61044f6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.505819] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d8a61120-07d4-4f92-9ff4-fc2b0d3c5e17 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_rules [ 864.506696] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_rules [ 864.507054] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.507278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.507362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.508144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.508274] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.613828] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0186212a-2a9e-481e-8d3d-5f09c24cb25a tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_rules [ 864.615032] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_rules [ 864.615168] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.615252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.033656] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.033839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.033914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.037610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.037610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.037610] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef already deleted. [ 865.037610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.037610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.037610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.037610] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.563689] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.563977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.563977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.564421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.564421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.564421] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef already deleted. [ 865.564421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.723364] env[65106]: INFO networking_nsxv3.common.synchronization [req-22944808-d894-4d67-9154-3af697058656 req-6afdba80-7c61-48d7-93cd-3f24f7e2c1b0 tempest-ListServersNegativeTestJSON-814622823 tempest-ListServersNegativeTestJSON-814622823-project-member] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 865.724106] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 865.726434] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.726579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.726649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.726854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.727031] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.727129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.727189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.727335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.727420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.727501] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.789418] env[65106]: INFO networking_nsxv3.common.synchronization [req-0de02599-ddda-413c-a478-ad29fe51fd83 req-5847ed31-828e-4a5f-b5a3-f358b15dd601 tempest-ListServersNegativeTestJSON-814622823 tempest-ListServersNegativeTestJSON-814622823-project-member] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 865.789418] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGHEST for action security_group_members [ 865.789418] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.789418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.231619] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.343918] env[65106]: INFO networking_nsxv3.common.synchronization [None req-17b9d80d-b6b5-4fc7-b819-fca61592c760 None None] Enqueued Resource ID: 68e2edce-656e-4294-8dc0-5476c63ec7a2 with Priority: HIGHEST for action port [ 866.344692] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e2edce-656e-4294-8dc0-5476c63ec7a2 with Priority: HIGHEST for action port [ 866.345013] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-68e2edce-656e-4294-8dc0-5476c63ec7a2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.346119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68e2edce-656e-4294-8dc0-5476c63ec7a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.346223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68e2edce-656e-4294-8dc0-5476c63ec7a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.346640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68e2edce-656e-4294-8dc0-5476c63ec7a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.346785] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68e2edce-656e-4294-8dc0-5476c63ec7a2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.733521] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.850160] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68e2edce-656e-4294-8dc0-5476c63ec7a2 [ 866.850160] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.850903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.851100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.851340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.851539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.851539] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68e2edce-656e-4294-8dc0-5476c63ec7a2 already deleted. [ 866.851637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68e2edce-656e-4294-8dc0-5476c63ec7a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.236817] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.236967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.237046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.237285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.237406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.237508] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 867.266205] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.266351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.266400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.267168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.267168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.276587] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 869.291047] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 869.291047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.291047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.291047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.291047] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.291047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.291047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.291047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.291047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.291047] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.793625] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.793862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.793862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.794134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.794235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.794419] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.794517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.794601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.794771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.794847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.794935] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be updated. [ 869.820939] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.821150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.821236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.821572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.821777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.833355] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: IN_PROGRESS for 2s [ 869.963324] env[65106]: INFO networking_nsxv3.common.synchronization [req-703178f4-80c6-4529-9f42-42429cebb05e req-3e042980-4d90-4600-b1da-96a62d76608b tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 869.963482] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 869.963827] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.963951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.964194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.964430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.965049] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.965168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.965301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.965428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.965501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.965618] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.401959] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.402297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.402342] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.402581] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.402827] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.402981] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.403328] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.403595] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.403757] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.403980] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.404101] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.404207] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.404310] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.404448] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.404580] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.404682] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.438724] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.439077] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.439162] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.439328] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.439638] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.439848] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.439988] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.440528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.440528] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.470101] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.835172] env[65106]: INFO networking_nsxv3.common.synchronization [None req-160644db-8d69-4d92-b31a-ebdfde5e86f0 None None] Enqueued Resource ID: b3a5528d-c52b-471e-8f31-5a38c6946469 with Priority: HIGHEST for action port [ 870.835172] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3a5528d-c52b-471e-8f31-5a38c6946469 with Priority: HIGHEST for action port [ 870.835172] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3a5528d-c52b-471e-8f31-5a38c6946469 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.835172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3a5528d-c52b-471e-8f31-5a38c6946469" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.835545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3a5528d-c52b-471e-8f31-5a38c6946469" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.835889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3a5528d-c52b-471e-8f31-5a38c6946469" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.836322] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3a5528d-c52b-471e-8f31-5a38c6946469',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.943613] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.947022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.947022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.947022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.947022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.947022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5 not found, creating... [ 870.947022] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.947022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.947022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.947022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.947022] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.947658] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.947658] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.947658] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.947658] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.947658] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.948080] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5 is going to be created. [ 870.968900] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.969132] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.969210] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.969493] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.969894] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.970175] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.970732] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.374088] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3a5528d-c52b-471e-8f31-5a38c6946469 [ 871.374088] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.374088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.374088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.374088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.374088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.374088] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3a5528d-c52b-471e-8f31-5a38c6946469 already deleted. [ 871.374088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3a5528d-c52b-471e-8f31-5a38c6946469" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.474374] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.474374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.474374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.474374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.474374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.474374] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 871.508571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.509460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.509460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.509460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.509460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.525432] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 871.769695] env[65106]: INFO networking_nsxv3.common.synchronization [req-703178f4-80c6-4529-9f42-42429cebb05e req-8af3b523-afbb-4d74-b475-827f38d0e504 service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 871.769695] env[65106]: INFO networking_nsxv3.common.synchronization [req-703178f4-80c6-4529-9f42-42429cebb05e req-8af3b523-afbb-4d74-b475-827f38d0e504 service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 871.769808] env[65106]: INFO networking_nsxv3.common.synchronization [req-703178f4-80c6-4529-9f42-42429cebb05e req-8af3b523-afbb-4d74-b475-827f38d0e504 service nova] Enqueued Resource ID: eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5 with Priority: HIGHEST for action port [ 871.770368] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 871.770587] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 871.770587] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5 with Priority: HIGHEST for action port [ 871.771404] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.771573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.771625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.771935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.771935] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.774032] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.774032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.774168] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.774299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.774411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.774602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.774821] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.845261] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 89b2fdad-d445-45cc-854d-bad422551520 in Status: SUCCESS [ 871.845261] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 89b2fdad-d445-45cc-854d-bad422551520 deletion is rescheduled due to dependency. [ 871.845371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.849142] env[65106]: INFO networking_nsxv3.common.synchronization [req-cea69251-89a4-4159-a753-906c661abdb2 req-fca81d27-6d57-4bd9-94d1-99c10d384e37 tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 871.849670] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 871.850567] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.850702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.850777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.851010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.852881] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.852881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.852881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.852881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.853080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.853177] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.278671] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.278671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.280073] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5 with status ACTIVE [ 872.280720] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.280720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.280720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.280862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.281018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.281070] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.282057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.282057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.282057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.282057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.282057] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.282057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.282057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.282057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.282057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.282499] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5 is going to be updated. [ 872.303655] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.303810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.303883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.304107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.304248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.304405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eb52e1cf-37b0-4b2d-84e4-bf714b9c08a5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.360409] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.360567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.360642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.360879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.360970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.361189] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.361290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.361352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.361535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.361637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.361697] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 872.401601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.401601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.401601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.401601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.401601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.413039] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 872.552622] env[65106]: INFO networking_nsxv3.common.synchronization [req-0adbc3fa-9197-4d28-aa02-2f8a5fae5e87 req-3869bc21-ce81-4e35-a281-816ae3da962c tempest-ServersNegativeTestMultiTenantJSON-1405190332 tempest-ServersNegativeTestMultiTenantJSON-1405190332-project-member] Enqueued Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGHEST for action security_group_members [ 872.553204] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGHEST for action security_group_members [ 872.553504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.553670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.553739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.553990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.554182] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.554279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.554335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.554500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.554557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.554669] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.914648] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-705 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.914865] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-705" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.914985] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-705" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.915811] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-705" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.916224] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.916445] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.916577] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.916823] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.916968] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.917188] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.917295] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 872.917400] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 872.917692] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 872.917692] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 872.917830] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 872.917971] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 872.944021] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 872.944021] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 872.944021] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 872.944021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-705" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.944021] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-5f93d9fb-7874-4f77-970f-608fba82df10 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.944021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-5f93d9fb-7874-4f77-970f-608fba82df10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.944021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-5f93d9fb-7874-4f77-970f-608fba82df10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.944358] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-5f93d9fb-7874-4f77-970f-608fba82df10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.944358] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f93d9fb-7874-4f77-970f-608fba82df10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.057042] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.057200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.057269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.057477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.057567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.057765] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.057859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.057920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.058090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.058166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.058250] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 already deleted. [ 873.058331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.447794] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.448033] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.448155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.448431] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.448568] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.448718] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 5f93d9fb-7874-4f77-970f-608fba82df10 not found, creating... [ 873.448978] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.449150] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.449264] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.450127] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.450127] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.450127] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.450127] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.450330] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.450449] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.450577] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.450713] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 5f93d9fb-7874-4f77-970f-608fba82df10 is going to be created. [ 873.478817] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.479821] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.479821] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.480324] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.480463] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.480907] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-5f93d9fb-7874-4f77-970f-608fba82df10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.537026] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 873.537251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.537432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.537651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.537840] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.537952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.538094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.538184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.538263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.538360] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.955378] env[65106]: INFO networking_nsxv3.common.synchronization [None req-4302d75d-9373-427e-95c3-ab2a78eb9948 None None] Enqueued Resource ID: 5f6e03e7-8d5d-4ab3-8777-875d9bbf5049 with Priority: HIGHEST for action port [ 873.955972] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f6e03e7-8d5d-4ab3-8777-875d9bbf5049 with Priority: HIGHEST for action port [ 873.957723] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f6e03e7-8d5d-4ab3-8777-875d9bbf5049 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.957723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f6e03e7-8d5d-4ab3-8777-875d9bbf5049" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.957723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f6e03e7-8d5d-4ab3-8777-875d9bbf5049" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.957723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f6e03e7-8d5d-4ab3-8777-875d9bbf5049" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.957723] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f6e03e7-8d5d-4ab3-8777-875d9bbf5049',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.040423] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.270995] env[65106]: INFO networking_nsxv3.common.synchronization [req-0adbc3fa-9197-4d28-aa02-2f8a5fae5e87 req-30d414dd-f004-4a40-99bd-f122fdbfffbb service nova] Enqueued Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGHEST for action security_group_rules [ 874.271397] env[65106]: INFO networking_nsxv3.common.synchronization [req-0adbc3fa-9197-4d28-aa02-2f8a5fae5e87 req-30d414dd-f004-4a40-99bd-f122fdbfffbb service nova] Enqueued Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGHEST for action security_group_members [ 874.271397] env[65106]: INFO networking_nsxv3.common.synchronization [req-0adbc3fa-9197-4d28-aa02-2f8a5fae5e87 req-30d414dd-f004-4a40-99bd-f122fdbfffbb service nova] Enqueued Resource ID: 5f93d9fb-7874-4f77-970f-608fba82df10 with Priority: HIGHEST for action port [ 874.272187] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGHEST for action security_group_rules [ 874.272366] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGHEST for action security_group_members [ 874.272510] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f93d9fb-7874-4f77-970f-608fba82df10 with Priority: HIGHEST for action port [ 874.272861] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.273120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.273205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.273706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.273706] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.274981] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.275126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.275247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.275369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.278888] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.278888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.278888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.278888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.278888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.278888] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.278888] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f93d9fb-7874-4f77-970f-608fba82df10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.278888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f93d9fb-7874-4f77-970f-608fba82df10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.278888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f93d9fb-7874-4f77-970f-608fba82df10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.278888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f93d9fb-7874-4f77-970f-608fba82df10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.278888] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f93d9fb-7874-4f77-970f-608fba82df10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.423336] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 874.423557] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 874.423754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.464283] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f6e03e7-8d5d-4ab3-8777-875d9bbf5049 [ 874.464544] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.464706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.464809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.465072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.465110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.465204] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f6e03e7-8d5d-4ab3-8777-875d9bbf5049 already deleted. [ 874.465280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f6e03e7-8d5d-4ab3-8777-875d9bbf5049" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.543140] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.782422] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.782664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.782781] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.783693] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5f93d9fb-7874-4f77-970f-608fba82df10 with status ACTIVE [ 874.783898] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.784024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.784094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.784294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.784378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.784543] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.784665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.784767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.784942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.786463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.786893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.788489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.788489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.788489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.788489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.788489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5f93d9fb-7874-4f77-970f-608fba82df10 is going to be updated. [ 874.810845] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.811009] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.811069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.811269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.811404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.811571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f93d9fb-7874-4f77-970f-608fba82df10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.046115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.046394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.046487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.047544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.047544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.047544] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 875.099245] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.099245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.099245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.099788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.100982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.114898] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 875.290686] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.795635] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.796520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.796662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.796987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.797177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.797320] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 is going to be created. [ 875.822389] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.822621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.822621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.822807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.823007] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.834173] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 in Status: UNINITIALIZED for 2s [ 876.131682] env[65106]: INFO networking_nsxv3.common.synchronization [req-0c74aa77-9656-4729-970d-6671536355e9 req-680f102b-8c46-491a-810d-f6319d082e98 tempest-InstanceActionsV221TestJSON-1485941587 tempest-InstanceActionsV221TestJSON-1485941587-project-member] Enqueued Resource ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 with Priority: HIGHEST for action security_group_members [ 876.132086] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 with Priority: HIGHEST for action security_group_members [ 876.132402] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2780c3aa-d7c0-4b04-ab51-f490d784ede7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.132526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.132594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.133040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.134231] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.134231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.134231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.134428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.134516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.134626] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2780c3aa-d7c0-4b04-ab51-f490d784ede7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.551201] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-893 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.551383] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-893" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.551563] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-893" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.551937] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-893" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.552278] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.552446] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.552563] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.552784] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.552927] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.553137] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.553246] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.553349] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.553460] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.553557] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.553735] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.553880] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.573475] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.573662] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.573845] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.574057] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-893" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.574404] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.574691] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.574847] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.575236] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.576069] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1b5a333-08a8-4daa-b78c-d21bd51e9d49',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.638686] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.638866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.638938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.639209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.639334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.639515] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.639620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.639684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.639853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.639931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.640029] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 already deleted. [ 876.640114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.078172] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.078473] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.078645] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.078980] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.079167] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.079378] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port d1b5a333-08a8-4daa-b78c-d21bd51e9d49 not found, creating... [ 877.079690] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.079929] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.080071] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.080345] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.080509] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.080849] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.081133] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.081280] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.081519] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.081748] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.081933] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: d1b5a333-08a8-4daa-b78c-d21bd51e9d49 is going to be created. [ 877.105063] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.105327] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.105437] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.105778] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.106127] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.106305] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.125902] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 877.127361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.127361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.127361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.127361] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.127361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.127361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.127361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.127361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.127361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.127802] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.630141] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.631194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.631194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.631194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.631194] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.631449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.631449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.631671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.631906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.632044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.632272] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.632453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.632657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.632721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.633131] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.633131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.633131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.633333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.633333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.633333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.633544] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.840855] env[65106]: INFO networking_nsxv3.common.synchronization [req-0c74aa77-9656-4729-970d-6671536355e9 req-86aa95e1-dd4a-4c35-b245-358a947c418b service nova] Enqueued Resource ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 with Priority: HIGHEST for action security_group_rules [ 877.841045] env[65106]: INFO networking_nsxv3.common.synchronization [req-0c74aa77-9656-4729-970d-6671536355e9 req-86aa95e1-dd4a-4c35-b245-358a947c418b service nova] Enqueued Resource ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 with Priority: HIGHEST for action security_group_members [ 877.841188] env[65106]: INFO networking_nsxv3.common.synchronization [req-0c74aa77-9656-4729-970d-6671536355e9 req-86aa95e1-dd4a-4c35-b245-358a947c418b service nova] Enqueued Resource ID: d1b5a333-08a8-4daa-b78c-d21bd51e9d49 with Priority: HIGHEST for action port [ 877.841904] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 with Priority: HIGHEST for action security_group_rules [ 877.842105] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 with Priority: HIGHEST for action security_group_members [ 877.842285] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1b5a333-08a8-4daa-b78c-d21bd51e9d49 with Priority: HIGHEST for action port [ 877.842669] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2780c3aa-d7c0-4b04-ab51-f490d784ede7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.842839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.842904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.843556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.843556] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2780c3aa-d7c0-4b04-ab51-f490d784ede7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.844282] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2780c3aa-d7c0-4b04-ab51-f490d784ede7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.844404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.844484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.844668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.844898] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.844965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.845049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.845224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.845286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.845369] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2780c3aa-d7c0-4b04-ab51-f490d784ede7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.846248] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.846450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.846535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.847387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.847387] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1b5a333-08a8-4daa-b78c-d21bd51e9d49',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.850102] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 in Status: SUCCESS [ 877.850102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.850102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.850102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.850102] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.850102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.850102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.850102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.850102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.850102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.851021] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.136981] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4b9f28-129e-4614-b2d6-9173d8122416: rpc.has_security_group_logging(os_id): False [ 878.156082] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.156273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.156603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.156603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.156748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.157019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.157145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.157223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.157400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.157493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.157738] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.157839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.157916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.158116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.158186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.158407] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.158528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.158632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.158818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.158920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.159034] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 878.230991] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.231218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.231218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.231490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.231664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.251176] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 878.348849] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2780c3aa-d7c0-4b04-ab51-f490d784ede7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.349045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.349268] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2780c3aa-d7c0-4b04-ab51-f490d784ede7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.354520] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d1b5a333-08a8-4daa-b78c-d21bd51e9d49 with status ACTIVE [ 878.354740] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.354878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.354945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.355190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.355286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.355490] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.355597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.355661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.355862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.355950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.356225] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.356319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.356383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.356531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.356596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.356688] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d1b5a333-08a8-4daa-b78c-d21bd51e9d49 is going to be updated. [ 878.357938] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.358086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.358133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.358288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.358457] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.358548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.358595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.359077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.359077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.359077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.359077] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.359492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.359492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.359492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.359711] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.359818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.359881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.360048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.360130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.360213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.360306] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.386584] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.386584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.386584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.386584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.386584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.386584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1b5a333-08a8-4daa-b78c-d21bd51e9d49" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.854980] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2780c3aa-d7c0-4b04-ab51-f490d784ede7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.863761] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d695ae0-3f98-46a7-8682-0daa0c8dbee9: rpc.has_security_group_logging(os_id): False [ 878.882577] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.882758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.882846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.883077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.883169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.883351] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.883451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.883503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.883743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.883895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.884215] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.884289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.884289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.885106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.885106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.885106] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.885106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.885106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.885106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.885106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.885106] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 is going to be created. [ 878.944745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.944884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.944955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.945189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.945368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.957667] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 in Status: IN_PROGRESS for 2s [ 879.357720] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.357720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.357720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.358035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.358087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.358191] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 is going to be created. [ 879.386767] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.386922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.386994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.387298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.387374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.400926] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 in Status: UNINITIALIZED for 2s [ 880.277717] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 880.277971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.972855] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 in Status: SUCCESS [ 880.972855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.412438] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 in Status: SUCCESS [ 881.412712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.413843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.414083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.414308] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.414430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.414512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.414792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.414792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.414886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.414942] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2780c3aa-d7c0-4b04-ab51-f490d784ede7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.919726] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2780c3aa-d7c0-4b04-ab51-f490d784ede7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.919901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.919997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.920309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.920480] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.920584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.920716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.920874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.920958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.921167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.921354] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2780c3aa-d7c0-4b04-ab51-f490d784ede7 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.922084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.922202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.922382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.922507] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.922618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.922686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.922845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.922925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.923015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.923512] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2780c3aa-d7c0-4b04-ab51-f490d784ede7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.426937] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2780c3aa-d7c0-4b04-ab51-f490d784ede7: rpc.has_security_group_logging(os_id): False [ 882.446215] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.446396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.446479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.446699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.446796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.446982] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.447104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.447165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.447314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.447388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.447560] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.447651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.447711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.447933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.447980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.448283] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.448382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.448439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.448605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.448697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.448785] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 is going to be created. [ 882.508228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.508228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.508425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.508600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.508863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.521700] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 in Status: IN_PROGRESS for 2s [ 882.843483] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 882.843635] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 883.245066] env[65106]: INFO networking_nsxv3.common.synchronization [req-f2a22e04-b340-44e2-8326-66fe48409fc8 req-9781e6d9-43e7-440d-add8-a059882a81cd tempest-ServersTestFqdnHostnames-225825114 tempest-ServersTestFqdnHostnames-225825114-project-member] Enqueued Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_members [ 883.245854] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGHEST for action security_group_members [ 883.246041] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.246160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.246213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.246382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.246541] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.246631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.246684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.246829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.246915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.247031] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.749507] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.749837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.749837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.750082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.750741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.750741] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.750741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.750741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.751017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.751017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.751414] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 is going to be updated. [ 883.794494] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.794821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.795097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.795418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.795700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.807344] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 in Status: IN_PROGRESS for 2s [ 884.537500] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 in Status: SUCCESS [ 884.537580] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.822628] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 in Status: SUCCESS [ 885.823158] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 deletion is rescheduled due to dependency. [ 885.823158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.126868] env[65106]: INFO networking_nsxv3.common.synchronization [None req-78b54b41-1fe4-41c5-8f7c-1534461803a5 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_rules [ 886.127634] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_rules [ 886.127823] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.127975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.128056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.128331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.128416] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.243207] env[65106]: INFO networking_nsxv3.common.synchronization [None req-8658f8ae-95bd-4c0c-8492-43a43267f021 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_rules [ 886.243570] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_rules [ 886.244310] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.244433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.509056] env[65106]: INFO networking_nsxv3.common.synchronization [req-73a5c508-77dd-4403-823c-275161c19e25 req-40fd730e-389b-4cde-9bcf-647a67efacce tempest-ServerRescueNegativeTestJSON-745464586 tempest-ServerRescueNegativeTestJSON-745464586-project-member] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 886.509613] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 886.509941] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.510140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.510440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.510440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.511042] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.511042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.511042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.511042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.511042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.511298] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.649933] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.652018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.652018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.652018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.652018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.652018] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 already deleted. [ 886.652018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.652018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.652018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.652018] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.900465] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.900741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.900741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.901255] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.901547] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.901721] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.901838] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.902086] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.902279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.902457] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.902564] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.902676] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.902825] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.902885] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.903047] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.903265] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.923510] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.923688] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.923856] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.924073] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.924379] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-f7c77920-49a2-4127-bad7-c6702b30cd15 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.924550] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-f7c77920-49a2-4127-bad7-c6702b30cd15" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.924745] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-f7c77920-49a2-4127-bad7-c6702b30cd15" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.925095] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-f7c77920-49a2-4127-bad7-c6702b30cd15" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.925248] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7c77920-49a2-4127-bad7-c6702b30cd15',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.014597] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.014744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.014847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.015434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.015539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.015937] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.016235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.016310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.016488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.016567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.016649] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef already deleted. [ 887.016728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.176059] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.176280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.176395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.176723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.176884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.177058] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 already deleted. [ 887.177184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.428252] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.428485] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.428607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.428908] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.429087] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.429243] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port f7c77920-49a2-4127-bad7-c6702b30cd15 not found, creating... [ 887.429507] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.429662] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.429776] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.429988] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.430162] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.430473] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.430598] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.430712] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.430928] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.432052] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.432052] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: f7c77920-49a2-4127-bad7-c6702b30cd15 is going to be created. [ 887.454411] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.454411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.454411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.454411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.454411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.454769] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-f7c77920-49a2-4127-bad7-c6702b30cd15" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.195436] env[65106]: INFO networking_nsxv3.common.synchronization [req-73a5c508-77dd-4403-823c-275161c19e25 req-fa897a60-2ff1-42fe-9a1b-6894e6020b4e service nova] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_rules [ 888.195713] env[65106]: INFO networking_nsxv3.common.synchronization [req-73a5c508-77dd-4403-823c-275161c19e25 req-fa897a60-2ff1-42fe-9a1b-6894e6020b4e service nova] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 888.195753] env[65106]: INFO networking_nsxv3.common.synchronization [req-73a5c508-77dd-4403-823c-275161c19e25 req-fa897a60-2ff1-42fe-9a1b-6894e6020b4e service nova] Enqueued Resource ID: f7c77920-49a2-4127-bad7-c6702b30cd15 with Priority: HIGHEST for action port [ 888.196293] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_rules [ 888.196430] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 888.200242] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7c77920-49a2-4127-bad7-c6702b30cd15 with Priority: HIGHEST for action port [ 888.200593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.200833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.200920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.201242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.201284] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.203318] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.203444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.203512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.203686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.203865] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.203962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.204037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.204183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.204262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.204356] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.206621] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7c77920-49a2-4127-bad7-c6702b30cd15 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.206621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7c77920-49a2-4127-bad7-c6702b30cd15" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.206621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7c77920-49a2-4127-bad7-c6702b30cd15" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.207428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7c77920-49a2-4127-bad7-c6702b30cd15" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.207428] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7c77920-49a2-4127-bad7-c6702b30cd15',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.365954] env[65106]: INFO networking_nsxv3.common.synchronization [req-0fede340-2b6f-4956-ab68-d3e24196d71f req-54b5837d-0051-410f-a70e-9fc21c05c3be tempest-ServersNegativeTestMultiTenantJSON-1405190332 tempest-ServersNegativeTestMultiTenantJSON-1405190332-project-member] Enqueued Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGHEST for action security_group_members [ 888.367028] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGHEST for action security_group_members [ 888.367364] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.367534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.367634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.367907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.368139] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.368280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.368375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.368592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.368720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.368861] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.704039] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.704220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.706594] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.709665] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7c77920-49a2-4127-bad7-c6702b30cd15 with status ACTIVE [ 888.710314] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.710495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.710570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.710858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.710966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.711195] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.711300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.711367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.711532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.711612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.711853] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.711903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.711969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.712113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.712191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.712308] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7c77920-49a2-4127-bad7-c6702b30cd15 is going to be updated. [ 888.743854] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.744159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.744299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.744640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.744885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.745186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7c77920-49a2-4127-bad7-c6702b30cd15" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.871967] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.872142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.872493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.872493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.872600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.872739] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.872859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.872924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.873093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.873177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.873264] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 is going to be updated. [ 888.909726] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.909867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.909932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.910172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.910315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.919836] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 in Status: IN_PROGRESS for 2s [ 888.988389] env[65106]: INFO networking_nsxv3.common.synchronization [req-52ddca89-9ecf-4675-a15c-3de2ac67a527 req-c81a4032-a3eb-4dde-8f0e-bb401ae15be9 tempest-ServerRescueNegativeTestJSON-745464586 tempest-ServerRescueNegativeTestJSON-745464586-project-member] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 888.989017] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 888.989380] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.989483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.215850] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.368427] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.368619] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.368739] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.369023] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.369271] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.369425] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.369536] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.369741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.369878] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.370083] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.370192] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.370294] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.370394] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.370494] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.370654] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.370805] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.394279] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.394279] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 889.394279] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.394543] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.394832] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-2162101e-e61d-4549-8a9c-19e6f41bbbb8 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.396486] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-2162101e-e61d-4549-8a9c-19e6f41bbbb8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.396486] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-2162101e-e61d-4549-8a9c-19e6f41bbbb8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.396486] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-2162101e-e61d-4549-8a9c-19e6f41bbbb8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.396486] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2162101e-e61d-4549-8a9c-19e6f41bbbb8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.717677] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.717846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.717929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.718148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.718234] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.718355] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be created. [ 889.746342] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.746342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.746342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.746342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.746342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.758052] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: UNINITIALIZED for 2s [ 889.902032] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.902032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.902032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.902032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.902032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.902032] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 2162101e-e61d-4549-8a9c-19e6f41bbbb8 not found, creating... [ 889.902032] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.902032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.902032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.902032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.902032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.902567] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.902567] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.902567] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.902567] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.902567] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.903044] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 2162101e-e61d-4549-8a9c-19e6f41bbbb8 is going to be created. [ 889.950020] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.950020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.950020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.950020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.950020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.950020] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-2162101e-e61d-4549-8a9c-19e6f41bbbb8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.669818] env[65106]: INFO networking_nsxv3.common.synchronization [req-52ddca89-9ecf-4675-a15c-3de2ac67a527 req-e90f0cf5-4bc6-42a0-a390-5f51bbe71aed service nova] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_rules [ 890.670114] env[65106]: INFO networking_nsxv3.common.synchronization [req-52ddca89-9ecf-4675-a15c-3de2ac67a527 req-e90f0cf5-4bc6-42a0-a390-5f51bbe71aed service nova] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 890.671588] env[65106]: INFO networking_nsxv3.common.synchronization [req-52ddca89-9ecf-4675-a15c-3de2ac67a527 req-e90f0cf5-4bc6-42a0-a390-5f51bbe71aed service nova] Enqueued Resource ID: 2162101e-e61d-4549-8a9c-19e6f41bbbb8 with Priority: HIGHEST for action port [ 890.673275] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_rules [ 890.673811] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 890.673811] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2162101e-e61d-4549-8a9c-19e6f41bbbb8 with Priority: HIGHEST for action port [ 890.673811] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.673955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.674109] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.674222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.674369] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2162101e-e61d-4549-8a9c-19e6f41bbbb8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.674486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2162101e-e61d-4549-8a9c-19e6f41bbbb8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.674515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2162101e-e61d-4549-8a9c-19e6f41bbbb8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.675189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2162101e-e61d-4549-8a9c-19e6f41bbbb8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.675189] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2162101e-e61d-4549-8a9c-19e6f41bbbb8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.932312] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 in Status: SUCCESS [ 890.932312] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 deletion is rescheduled due to dependency. [ 890.932312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.177314] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2162101e-e61d-4549-8a9c-19e6f41bbbb8 with status ACTIVE [ 891.177668] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.178405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.178405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.178405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.178405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.178593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.178648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.179496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.179496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.179496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.179496] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.179496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.179496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.179929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.179929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.179929] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2162101e-e61d-4549-8a9c-19e6f41bbbb8 is going to be updated. [ 891.186804] env[65106]: INFO networking_nsxv3.common.synchronization [req-f76cb876-02a4-4a22-9681-002ad9b3ab78 req-5dceada5-30fb-44f7-884c-9225858adf77 tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 891.187063] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 891.188134] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.188134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.188134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.188134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.188134] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.188134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.188134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.188393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.188393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.188393] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.202044] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.202044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.202044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.202330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.202330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.202475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2162101e-e61d-4549-8a9c-19e6f41bbbb8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.623930] env[65106]: INFO networking_nsxv3.common.synchronization [req-c1ff849e-efb6-489f-82b6-4664ca027885 req-3d295671-ef84-46da-b3b6-51d67e20ae57 tempest-InstanceActionsV221TestJSON-1485941587 tempest-InstanceActionsV221TestJSON-1485941587-project-member] Enqueued Resource ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 with Priority: HIGHEST for action security_group_members [ 891.625034] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 with Priority: HIGHEST for action security_group_members [ 891.625034] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2780c3aa-d7c0-4b04-ab51-f490d784ede7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.625034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.625255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.625309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.625452] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.625553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.625616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.625766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.625852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.625948] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2780c3aa-d7c0-4b04-ab51-f490d784ede7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.656820] env[65106]: INFO networking_nsxv3.common.synchronization [req-2ba9ce59-1bea-4b49-8189-8f20e192bf28 req-9b9575cc-28bf-4a7f-9961-5cbea5edae77 tempest-ImagesOneServerNegativeTestJSON-531782934 tempest-ImagesOneServerNegativeTestJSON-531782934-project-member] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 891.657329] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 891.657955] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.658103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.658168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.658383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.658540] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.658638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.658700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.658867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.659032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.659098] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.690410] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.771533] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: SUCCESS [ 891.771791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.771953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.772187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.772558] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.772691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.772823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.773010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.773105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.773219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.773319] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.775287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.775287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.775287] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.775287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.775287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.775287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.775287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.775287] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.046579] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-71 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.046579] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.046579] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.046579] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.046579] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.046579] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.046579] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.046579] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.046579] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.046579] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.047260] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.047260] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.047260] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.047260] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.047260] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.047260] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.068710] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.068865] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.069020] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.069208] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.069553] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-dd71d963-6528-496d-a4fd-adf874cfd28a taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.069752] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-dd71d963-6528-496d-a4fd-adf874cfd28a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.070104] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-dd71d963-6528-496d-a4fd-adf874cfd28a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.070226] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-dd71d963-6528-496d-a4fd-adf874cfd28a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.070833] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd71d963-6528-496d-a4fd-adf874cfd28a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.128757] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.128927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.129058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.129276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.129576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.129839] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.129977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.130040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.130207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.130317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.130374] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 is going to be updated. [ 892.163620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.163867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.163944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.164216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.164323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.164545] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.164648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.164710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.165053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.165136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.165306] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 892.169475] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.169602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.169671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.169864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.170040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.185151] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 in Status: IN_PROGRESS for 2s [ 892.195083] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.200105] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.200265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.200336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.200559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.200700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.219022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 892.278044] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.278044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.278044] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.576023] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.576294] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.576420] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.576805] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.576973] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.577203] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port dd71d963-6528-496d-a4fd-adf874cfd28a not found, creating... [ 892.577549] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.577744] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.577861] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.578135] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.578277] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.578646] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.578787] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.578925] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.579191] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.579351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.579534] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: dd71d963-6528-496d-a4fd-adf874cfd28a is going to be created. [ 892.621042] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.621432] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.621567] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.621881] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.622194] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.622485] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-dd71d963-6528-496d-a4fd-adf874cfd28a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.698030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.698418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.698418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.698766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.698871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.698979] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 892.768565] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.768565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.768565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.768565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.768565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.778918] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 892.781501] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.285262] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.285505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.285505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.285726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.285819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.286089] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be updated. [ 893.329151] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.329372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.329372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.329569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.329719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.339976] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: IN_PROGRESS for 2s [ 893.350561] env[65106]: INFO networking_nsxv3.common.synchronization [req-2ba9ce59-1bea-4b49-8189-8f20e192bf28 req-4d40d2bb-af36-4a25-8e33-408b39d19ce2 service nova] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_rules [ 893.350737] env[65106]: INFO networking_nsxv3.common.synchronization [req-2ba9ce59-1bea-4b49-8189-8f20e192bf28 req-4d40d2bb-af36-4a25-8e33-408b39d19ce2 service nova] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 893.350898] env[65106]: INFO networking_nsxv3.common.synchronization [req-2ba9ce59-1bea-4b49-8189-8f20e192bf28 req-4d40d2bb-af36-4a25-8e33-408b39d19ce2 service nova] Enqueued Resource ID: dd71d963-6528-496d-a4fd-adf874cfd28a with Priority: HIGHEST for action port [ 893.351491] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_rules [ 893.351631] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 893.351727] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd71d963-6528-496d-a4fd-adf874cfd28a with Priority: HIGHEST for action port [ 893.351997] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.352122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.352189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.352471] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.352471] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.353835] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.353835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.354044] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd71d963-6528-496d-a4fd-adf874cfd28a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.354163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd71d963-6528-496d-a4fd-adf874cfd28a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.355072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd71d963-6528-496d-a4fd-adf874cfd28a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.355072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd71d963-6528-496d-a4fd-adf874cfd28a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.355072] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd71d963-6528-496d-a4fd-adf874cfd28a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.358487] env[65106]: INFO networking_nsxv3.common.synchronization [req-12f92e44-d299-44ba-8c98-07f565f2dd51 req-f2327dfe-096a-43f0-b04c-2667c39d5d97 tempest-MigrationsAdminTest-232602271 tempest-MigrationsAdminTest-232602271-project-member] Enqueued Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 893.358487] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 893.358487] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.358487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.358487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.358487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.359029] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.359029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.359029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.359029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.359029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.359029] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.856105] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.856520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.858610] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd71d963-6528-496d-a4fd-adf874cfd28a with status ACTIVE [ 893.858893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.858980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.859078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.859308] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.859421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.859625] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.859742] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.859821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.860012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.860128] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.860333] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.860431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.860503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.860678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.860768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.860869] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd71d963-6528-496d-a4fd-adf874cfd28a is going to be updated. [ 893.862254] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.884710] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.884868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.884941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.885181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.885322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.885482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd71d963-6528-496d-a4fd-adf874cfd28a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.194876] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 in Status: SUCCESS [ 894.195097] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2780c3aa-d7c0-4b04-ab51-f490d784ede7 deletion is rescheduled due to dependency. [ 894.195220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2780c3aa-d7c0-4b04-ab51-f490d784ede7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.227657] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 894.227845] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd deletion is rescheduled due to dependency. [ 894.227961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.228144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.228351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.228535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.228650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.228713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.228863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.228941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.229045] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.365444] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.731435] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.792219] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 894.792335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.867300] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.867641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.867641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.867973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.867973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.867973] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c is going to be updated. [ 894.906079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.906220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.906413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.906490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.906638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.918882] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: IN_PROGRESS for 2s [ 895.235618] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.357581] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: SUCCESS [ 895.357814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.357995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.358323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.358538] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.358698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.358769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.358934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.359059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.359166] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.737376] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.737492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.737589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.737890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.737890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.737992] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 895.767089] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.767089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.767089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.767540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.767782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.779389] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 895.862202] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.364823] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.867545] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.867903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.867903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.868046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.868222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.868293] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be updated. [ 896.896409] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.896560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.896633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.896946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.897136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.907215] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: IN_PROGRESS for 2s [ 896.929667] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: SUCCESS [ 896.929894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.790347] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 897.790627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.790784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.791089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.791336] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.791481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.791568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.791773] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.791928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.792075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.792198] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.297285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.297285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.297285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.297285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.297285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.297897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.298588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.298810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.298948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.299913] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.358713] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 898.358713] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 898.802060] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 80c55b4c-229d-4278-a249-6eb0843ce4fd: rpc.has_security_group_logging(os_id): False [ 898.823032] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.823032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.823032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.823032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.823032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.823325] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.823374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.823415] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.823577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.823705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.823938] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.824039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.825011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.825011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.825011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.825011] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.825011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.825011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.825011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.825011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.825011] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 898.883616] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.883808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.883902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.884143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.884292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.898733] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 898.917794] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: SUCCESS [ 898.918065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.918247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.918512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.918744] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.918923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.919396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.919396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.919396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.919531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.919787] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.919914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.920082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.920219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.920438] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.920565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.920670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.920888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.921011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.921158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.921232] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.424162] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f20d6572-0b4b-48a0-8c23-2a251368deef: rpc.has_security_group_logging(os_id): False [ 899.444518] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.444660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.444732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.444955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.445055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.445323] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.445457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.445526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.445714] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.445797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.445984] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.446096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.446185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.446342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.446566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.446639] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.446715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.446778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.446995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.447121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.447232] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be created. [ 899.507546] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.507716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.507716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.507935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.508120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.521440] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: IN_PROGRESS for 2s [ 900.913034] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 900.913034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.460432] env[65106]: INFO networking_nsxv3.common.synchronization [req-e961aad6-c04c-4eee-b2be-ef97c28b7762 req-4a42a83c-9324-4a49-8c76-91e4ade26963 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 901.460788] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 901.461107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.461485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.461562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.461761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.461924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.463139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.463253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.463431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.463522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.463619] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.535299] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: SUCCESS [ 901.535879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.535879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.536106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.536204] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.865834] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.866081] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.866214] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.866466] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.866725] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.866906] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.866989] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.867552] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.867772] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.867916] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.868041] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 901.868155] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 901.868262] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 901.868373] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 901.868539] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 901.868706] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 901.889283] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 901.889441] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 901.889571] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 901.889742] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.890064] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-ee9847c9-db1f-4d42-a013-37b7b33f59c7 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.890253] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-ee9847c9-db1f-4d42-a013-37b7b33f59c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.890346] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-ee9847c9-db1f-4d42-a013-37b7b33f59c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.890662] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-ee9847c9-db1f-4d42-a013-37b7b33f59c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.890799] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9847c9-db1f-4d42-a013-37b7b33f59c7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.965511] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.965928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.965928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.965928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.966129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.966323] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.966472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.966542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.966689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.966753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.966865] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 901.996180] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.996404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.996516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.996652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.996821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.005840] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 902.040891] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.040891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.040891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.041127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.041127] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.041250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.041250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.041398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.041496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.041584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.041672] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.395142] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.395142] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.395142] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.395514] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.395514] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.395905] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port ee9847c9-db1f-4d42-a013-37b7b33f59c7 not found, creating... [ 902.396202] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.396479] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.396682] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.397541] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.397775] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.398257] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.398509] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.398676] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.399364] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.400055] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.400055] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: ee9847c9-db1f-4d42-a013-37b7b33f59c7 is going to be created. [ 902.422757] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.423069] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.423136] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.423399] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.423629] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.423874] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-ee9847c9-db1f-4d42-a013-37b7b33f59c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.543694] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.543910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.544022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.544257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.544426] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.544528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.544583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.544733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.544822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.544921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.545118] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.545206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.545319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.545454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.545593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.545682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.545902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.545902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.545953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.546038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.546163] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.049876] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f20d6572-0b4b-48a0-8c23-2a251368deef: rpc.has_security_group_logging(os_id): False [ 903.068993] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.068993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.068993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.068993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.068993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.068993] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.068993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.068993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.068993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.068993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.069373] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.069373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.069373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.069373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.069483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.069636] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.069706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.069749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.069894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.070050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.070050] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be updated. [ 903.138622] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.140244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.140244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.140361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.140520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.154902] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: IN_PROGRESS for 2s [ 903.157647] env[65106]: INFO networking_nsxv3.common.synchronization [req-e961aad6-c04c-4eee-b2be-ef97c28b7762 req-f788df89-50d4-491d-ae99-27b09cd6cf39 service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 903.157647] env[65106]: INFO networking_nsxv3.common.synchronization [req-e961aad6-c04c-4eee-b2be-ef97c28b7762 req-f788df89-50d4-491d-ae99-27b09cd6cf39 service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 903.157776] env[65106]: INFO networking_nsxv3.common.synchronization [req-e961aad6-c04c-4eee-b2be-ef97c28b7762 req-f788df89-50d4-491d-ae99-27b09cd6cf39 service nova] Enqueued Resource ID: ee9847c9-db1f-4d42-a013-37b7b33f59c7 with Priority: HIGHEST for action port [ 903.158251] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 903.158382] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 903.158478] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee9847c9-db1f-4d42-a013-37b7b33f59c7 with Priority: HIGHEST for action port [ 903.158753] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.158858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.158965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.159143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.159222] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.160069] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.160145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.160314] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee9847c9-db1f-4d42-a013-37b7b33f59c7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.160411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee9847c9-db1f-4d42-a013-37b7b33f59c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.160474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee9847c9-db1f-4d42-a013-37b7b33f59c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.160644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee9847c9-db1f-4d42-a013-37b7b33f59c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.160696] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee9847c9-db1f-4d42-a013-37b7b33f59c7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.662538] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.662794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.665140] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee9847c9-db1f-4d42-a013-37b7b33f59c7 with status ACTIVE [ 903.665365] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.665503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.665568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.665803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.665875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.666298] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.666298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.666298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.666409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.666442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.666623] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.666703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.666766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.666900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.666986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.667107] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee9847c9-db1f-4d42-a013-37b7b33f59c7 is going to be updated. [ 903.691447] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.691693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.691693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.692237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.692404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.692576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee9847c9-db1f-4d42-a013-37b7b33f59c7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.724760] env[65106]: INFO networking_nsxv3.common.synchronization [req-5410948c-b406-4d24-9877-2add67deea2c req-c1010857-90bc-4f78-9980-43efd0c1d20c tempest-ServersAdminTestJSON-1615839610 tempest-ServersAdminTestJSON-1615839610-project-member] Enqueued Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 903.725665] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 with Priority: HIGHEST for action security_group_members [ 903.725917] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.726069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.726156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.726389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.726552] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.726673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.726726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.726949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.727057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.727158] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f58b21a0-a1cb-4daa-9136-8c66dc9641d3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.015861] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 904.016075] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 904.016205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.016359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.016571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.016754] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.016872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.016937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.017224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.017224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.017388] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.204828] env[65106]: INFO networking_nsxv3.common.synchronization [req-672599e3-35c3-424c-b2d1-5cbb879065f3 req-7ab8ec63-7b89-4070-b31d-9bb7265f8cd3 tempest-FloatingIPsAssociationTestJSON-1367400107 tempest-FloatingIPsAssociationTestJSON-1367400107-project-member] Enqueued Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 904.205606] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 904.205664] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.205759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.205826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.207201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.207561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.207712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.207784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.207979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.208071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.208168] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.229751] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.229751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.230081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.230617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.252257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.252687] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.252847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.252916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.253194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.253230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.253341] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 is going to be updated. [ 904.282545] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.282684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.282751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.282971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.283128] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.292272] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: IN_PROGRESS for 2s [ 904.520072] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.535097] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.535097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-457" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.535097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-457" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.535097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-457" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.535097] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.535097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.535097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.535714] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.536660] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.536660] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.536660] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.538517] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.538517] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.538517] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.538517] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.538517] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.556068] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.556328] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.556328] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.556466] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-457" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.556814] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.556991] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.557129] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.557453] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.557595] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fa0bd05-d7ef-4667-a6a1-8bc8068593c8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.711644] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.711644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.711644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.711825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.711825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.712011] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.712117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.712180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.712328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.712401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.712481] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 already deleted. [ 904.712559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.023470] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.061313] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.061313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.061313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.061478] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.062305] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.062305] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 7fa0bd05-d7ef-4667-a6a1-8bc8068593c8 not found, creating... [ 905.062305] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.062487] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.062527] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.062737] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.062871] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.063160] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.065451] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.065451] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.065451] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.065451] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.065451] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 7fa0bd05-d7ef-4667-a6a1-8bc8068593c8 is going to be created. [ 905.085104] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.085244] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.085344] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.085626] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.085854] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.086110] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.184498] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: SUCCESS [ 905.184730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.526567] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.526894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.526894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.528167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.528167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.528167] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 905.560838] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.561110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.561225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.561642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.561898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.574164] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 905.842444] env[65106]: INFO networking_nsxv3.common.synchronization [req-672599e3-35c3-424c-b2d1-5cbb879065f3 req-c53c6615-5d6c-416e-b18e-c054ee2c6183 service nova] Enqueued Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_rules [ 905.842691] env[65106]: INFO networking_nsxv3.common.synchronization [req-672599e3-35c3-424c-b2d1-5cbb879065f3 req-c53c6615-5d6c-416e-b18e-c054ee2c6183 service nova] Enqueued Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 905.842851] env[65106]: INFO networking_nsxv3.common.synchronization [req-672599e3-35c3-424c-b2d1-5cbb879065f3 req-c53c6615-5d6c-416e-b18e-c054ee2c6183 service nova] Enqueued Resource ID: 7fa0bd05-d7ef-4667-a6a1-8bc8068593c8 with Priority: HIGHEST for action port [ 905.843460] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_rules [ 905.843599] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 905.843697] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fa0bd05-d7ef-4667-a6a1-8bc8068593c8 with Priority: HIGHEST for action port [ 905.844017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.847443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.847443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.847740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.847841] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.850657] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.851124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.851124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.852271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.853048] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.854724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.854848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.855101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.855200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.855320] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.856661] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.856661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.856661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.856956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.856956] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fa0bd05-d7ef-4667-a6a1-8bc8068593c8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.308091] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 in Status: SUCCESS [ 906.308421] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f58b21a0-a1cb-4daa-9136-8c66dc9641d3 deletion is rescheduled due to dependency. [ 906.308624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f58b21a0-a1cb-4daa-9136-8c66dc9641d3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.358595] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.358776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.361221] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.362453] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fa0bd05-d7ef-4667-a6a1-8bc8068593c8 with status ACTIVE [ 906.365504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.365504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.365504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.365998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.365998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.366119] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fa0bd05-d7ef-4667-a6a1-8bc8068593c8 is going to be updated. [ 906.392311] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.392552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.392683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.393042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.393281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.393544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fa0bd05-d7ef-4667-a6a1-8bc8068593c8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.846734] env[65106]: INFO networking_nsxv3.common.synchronization [req-697a786e-1a7f-4578-88ab-d0d4c062e200 req-c0daf74b-8f19-4481-a3c1-464694651080 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_members [ 906.847850] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_members [ 906.848323] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.848516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.848621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.848983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.849263] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.849430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.849539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.849790] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.850098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.850270] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.869419] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.310661] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.310928] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.311174] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.311643] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.312026] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.312223] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.312342] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.312588] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.312726] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.312937] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.313056] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 907.313163] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 907.313265] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 907.313373] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 907.313487] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 907.313622] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 907.333872] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 907.334112] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 907.334264] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 907.334446] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.334764] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-84c85559-734c-4b48-b51e-6efeefc43d6e taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.335077] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-84c85559-734c-4b48-b51e-6efeefc43d6e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.335173] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-84c85559-734c-4b48-b51e-6efeefc43d6e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.335528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-84c85559-734c-4b48-b51e-6efeefc43d6e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.335667] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84c85559-734c-4b48-b51e-6efeefc43d6e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.352587] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.352780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.352844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.353038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.353135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.354022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.354022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.354022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.354022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.354022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.354022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef already deleted. [ 907.354022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.377971] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.377971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.377971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.377971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.377971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.377971] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 is going to be created. [ 907.412865] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.413045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.413224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.413532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.413532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.424443] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: UNINITIALIZED for 2s [ 907.586413] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 907.586413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.586413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.586413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.586413] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.586413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.586413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.586413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.586413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.586413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.586413] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.818237] env[65106]: INFO networking_nsxv3.common.synchronization [req-b8870e48-1384-46db-af36-7b51506aec82 req-38a55533-3202-4b70-ace5-5f42eafe573d tempest-ServerRescueTestJSON-731943944 tempest-ServerRescueTestJSON-731943944-project-member] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 907.818906] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGHEST for action security_group_members [ 907.819245] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.819382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.819483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.819741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.819962] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.820142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.820249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.820513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.820620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.820759] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.838523] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.838742] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.838884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.839514] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.839681] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.839846] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 84c85559-734c-4b48-b51e-6efeefc43d6e not found, creating... [ 907.840125] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.840285] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.840400] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.840628] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.840775] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.841245] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.841404] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.841531] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.841803] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.841960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.842113] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 84c85559-734c-4b48-b51e-6efeefc43d6e is going to be created. [ 907.865492] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.865867] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.865867] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.866475] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.866832] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.867354] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-84c85559-734c-4b48-b51e-6efeefc43d6e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.088657] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.088855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.088933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.089231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.089416] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.089522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.089595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.089750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.090040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.090178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.090334] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.090426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.090485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.090628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.091410] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.092121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.092209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.092367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.092450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.092535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.092629] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.208847] env[65106]: INFO networking_nsxv3.common.synchronization [req-bef43476-3000-4dc9-99ff-afcb7d482561 req-1bd79538-2735-4512-8ef9-2964fe2279e5 tempest-ImagesOneServerNegativeTestJSON-531782934 tempest-ImagesOneServerNegativeTestJSON-531782934-project-member] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 908.209566] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGHEST for action security_group_members [ 908.209885] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.210021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.210165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.210369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.210543] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.210659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.210659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.210805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.210897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.211038] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.323468] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.323683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.323761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.324065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.324257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.324555] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.324786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.324875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.325109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.325269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.325372] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be updated. [ 908.361483] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.361603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.361676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.362016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.362139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.371316] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: IN_PROGRESS for 2s [ 908.592478] env[65106]: INFO networking_nsxv3.common.synchronization [req-697a786e-1a7f-4578-88ab-d0d4c062e200 req-73c86d00-a110-4885-8129-7abfd9a5c723 service nova] Enqueued Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_rules [ 908.592682] env[65106]: INFO networking_nsxv3.common.synchronization [req-697a786e-1a7f-4578-88ab-d0d4c062e200 req-73c86d00-a110-4885-8129-7abfd9a5c723 service nova] Enqueued Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_members [ 908.592830] env[65106]: INFO networking_nsxv3.common.synchronization [req-697a786e-1a7f-4578-88ab-d0d4c062e200 req-73c86d00-a110-4885-8129-7abfd9a5c723 service nova] Enqueued Resource ID: 84c85559-734c-4b48-b51e-6efeefc43d6e with Priority: HIGHEST for action port [ 908.596530] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_rules [ 908.596739] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_members [ 908.596881] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84c85559-734c-4b48-b51e-6efeefc43d6e with Priority: HIGHEST for action port [ 908.597124] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cf4d8d-838b-4bef-8391-fb65a3ba9c75: rpc.has_security_group_logging(os_id): False [ 908.598222] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.598374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.598446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.598655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.598752] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.600270] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.600476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.600514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.600709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.600989] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.601190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.601241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.601536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.601629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.601722] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.602925] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-84c85559-734c-4b48-b51e-6efeefc43d6e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.603043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84c85559-734c-4b48-b51e-6efeefc43d6e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.603114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84c85559-734c-4b48-b51e-6efeefc43d6e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.603434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84c85559-734c-4b48-b51e-6efeefc43d6e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.603434] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84c85559-734c-4b48-b51e-6efeefc43d6e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.622060] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.622200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.622332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.623067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.623067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.623067] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.623067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.623067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.623464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.623464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.623464] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.623611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.623611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.623731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.623806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.624736] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.624736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.624736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.624999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.624999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.625100] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 908.697588] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.697588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.697588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.697588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.697588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.713498] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 908.713683] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.713810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.713956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.714761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.714761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.714761] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.714761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.714761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.718783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.718783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.718783] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be updated. [ 908.760099] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.760341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.760416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.761094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.761320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.773693] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: IN_PROGRESS for 2s [ 909.104233] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.105485] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84c85559-734c-4b48-b51e-6efeefc43d6e with status ACTIVE [ 909.105725] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.105898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.105997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.106280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.106339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.106563] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.106690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.106756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.106942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.107767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.108376] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.108523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.108597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.108755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.108835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.108931] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84c85559-734c-4b48-b51e-6efeefc43d6e is going to be updated. [ 909.110146] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.110291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.133623] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.133768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.133850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.134550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.134550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.134550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84c85559-734c-4b48-b51e-6efeefc43d6e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.221038] env[65106]: INFO networking_nsxv3.common.synchronization [req-31c61bd3-db5a-4b37-8558-fddf88397cc9 req-153492f8-8dc0-4408-a7d8-a8623bbfdd91 tempest-ServersV294TestFqdnHostnames-641786378 tempest-ServersV294TestFqdnHostnames-641786378-project-member] Enqueued Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_members [ 909.221970] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGHEST for action security_group_members [ 909.222068] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.222427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.222427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.222867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.222867] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.222965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.222965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.223239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.223304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.223403] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.438379] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: SUCCESS [ 909.438379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.438569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.438622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.438796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.438919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.438980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.439153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.439230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.439314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.439408] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.611740] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.726126] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.726274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.726368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.726557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.726662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.726859] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.726992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.726992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.727163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.727610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.727610] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 is going to be updated. [ 909.754561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.754829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.754829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.755192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.755260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.765238] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5e826db-704a-4f90-8b10-2d48839251d7 in Status: IN_PROGRESS for 2s [ 909.947142] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.947319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.947391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.947649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.947841] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.947949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.948030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.948200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.948291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.948379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.948529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.948621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.948682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.948824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.948962] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.949068] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.949135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.949135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.949135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.949554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.949554] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.120987] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.120987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.120987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.120987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.120987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.120987] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef is going to be created. [ 910.150075] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.150243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.150315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.150531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.150698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.162835] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aef9a0c3-8949-42e0-b152-6d0e475589ef in Status: UNINITIALIZED for 2s [ 910.382373] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 in Status: SUCCESS [ 910.382558] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 deletion is rescheduled due to dependency. [ 910.382673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.417140] env[65106]: INFO networking_nsxv3.common.synchronization [req-22a03168-6fc1-46ab-928d-11a77f418d6c req-6df5ab61-4303-40b8-87f0-c848c8215376 tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 910.417660] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 910.418775] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.419184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.419321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.419550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.419731] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.419825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.419889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.420330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.420330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.420806] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.451797] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a791c8c3-0f7e-4205-8d3d-977dc22a4708: rpc.has_security_group_logging(os_id): False [ 910.471919] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.472155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.472224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.472535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.472984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.473782] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.473999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.474136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.474363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.474434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.474661] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.474772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.474845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.475053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.475136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.475323] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.475419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.475485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.475630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.475708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.475821] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 is going to be created. [ 910.547054] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.547289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.547399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.547622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.547810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.562279] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: IN_PROGRESS for 2s [ 910.731176] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 910.731176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.783738] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd in Status: SUCCESS [ 910.784294] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd deletion is rescheduled due to dependency. [ 910.784689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.828281] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.828655] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.828882] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.829254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.830571] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.830815] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.830975] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.831319] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.831485] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.833113] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.833113] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.833113] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.833113] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.833113] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.833113] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.833113] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.853609] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.853609] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.853609] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.853818] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.854152] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-ac4e5752-206e-477d-a946-7cf6ff8e739c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.855016] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-ac4e5752-206e-477d-a946-7cf6ff8e739c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.855016] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-ac4e5752-206e-477d-a946-7cf6ff8e739c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.855016] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-ac4e5752-206e-477d-a946-7cf6ff8e739c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.855016] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac4e5752-206e-477d-a946-7cf6ff8e739c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.925056] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.925247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.925330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.925589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.925651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.925899] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.926023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.926102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.926257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.926354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.926450] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 910.961541] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.961802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.961862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.962157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.962391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.974012] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 911.357718] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.357718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.357718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.358162] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.358162] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.358290] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port ac4e5752-206e-477d-a946-7cf6ff8e739c not found, creating... [ 911.358741] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.358741] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.358904] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.359119] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.359187] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.359447] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.359601] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.359713] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.360176] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.360176] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.360176] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: ac4e5752-206e-477d-a946-7cf6ff8e739c is going to be created. [ 911.381478] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.381779] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.381874] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.382097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.382327] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.383434] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-ac4e5752-206e-477d-a946-7cf6ff8e739c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.776738] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f5e826db-704a-4f90-8b10-2d48839251d7 in Status: SUCCESS [ 911.776901] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 deletion is rescheduled due to dependency. [ 911.777108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.168303] env[65106]: INFO networking_nsxv3.common.synchronization [req-22a03168-6fc1-46ab-928d-11a77f418d6c req-0e11b0e9-51a1-40a2-b61b-dfb85055fc51 service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 912.168303] env[65106]: INFO networking_nsxv3.common.synchronization [req-22a03168-6fc1-46ab-928d-11a77f418d6c req-0e11b0e9-51a1-40a2-b61b-dfb85055fc51 service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 912.168483] env[65106]: INFO networking_nsxv3.common.synchronization [req-22a03168-6fc1-46ab-928d-11a77f418d6c req-0e11b0e9-51a1-40a2-b61b-dfb85055fc51 service nova] Enqueued Resource ID: ac4e5752-206e-477d-a946-7cf6ff8e739c with Priority: HIGHEST for action port [ 912.169092] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 912.169289] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 912.169352] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac4e5752-206e-477d-a946-7cf6ff8e739c with Priority: HIGHEST for action port [ 912.169733] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.169854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.169899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.173224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.173224] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.173224] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.173224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.173224] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac4e5752-206e-477d-a946-7cf6ff8e739c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.173224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac4e5752-206e-477d-a946-7cf6ff8e739c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.173572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac4e5752-206e-477d-a946-7cf6ff8e739c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.173666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac4e5752-206e-477d-a946-7cf6ff8e739c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.173666] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac4e5752-206e-477d-a946-7cf6ff8e739c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.179520] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aef9a0c3-8949-42e0-b152-6d0e475589ef in Status: SUCCESS [ 912.179520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.179520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.179520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.179520] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.179520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.179520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.179520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.179520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.179520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.179520] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.576517] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: SUCCESS [ 912.576865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.681528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.681528] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac4e5752-206e-477d-a946-7cf6ff8e739c with status ACTIVE [ 912.681528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.681528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.681528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.681528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.682232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.682232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.682232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.682232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.682232] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac4e5752-206e-477d-a946-7cf6ff8e739c is going to be updated. [ 912.686614] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.721025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.721735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.721735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.721735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.721920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.721961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac4e5752-206e-477d-a946-7cf6ff8e739c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.987191] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 912.987447] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 912.987584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.987754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.987978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.988185] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.988352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.988416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.988619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.988671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.988759] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.189458] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aef9a0c3-8949-42e0-b152-6d0e475589ef: rpc.has_security_group_logging(os_id): False [ 913.207613] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.207765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.207837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.208171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.208581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.208581] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.208725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.208725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.208916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.209054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.209315] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef is going to be created. [ 913.286120] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.286120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.286120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.286120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.286120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.297473] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aef9a0c3-8949-42e0-b152-6d0e475589ef in Status: IN_PROGRESS for 2s [ 913.492247] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.995533] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.498533] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.498533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.498640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.500384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.500494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.500617] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 914.530358] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.530636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.530725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.530929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.531088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.546050] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 915.311123] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aef9a0c3-8949-42e0-b152-6d0e475589ef in Status: SUCCESS [ 915.311495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.553731] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 916.554402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.554585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.554833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.556079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.556079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.556079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.556079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.556079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.556079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.556079] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.059188] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.059379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.059437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.059764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.060608] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.060608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.060608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.060608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.060608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.060608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.062165] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.064385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.064385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.064385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.064385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.064385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.064385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.064385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.064385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.064385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.064385] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.170461] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 917.170542] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 917.568600] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00fc8ecc-2b12-478d-8a50-43a7183605bc: rpc.has_security_group_logging(os_id): False [ 917.588361] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.588361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.588361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.588712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.589089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.589392] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.589550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.589779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.589897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.590026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.590678] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.590678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.590678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.590853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.590853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.591132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.591132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.591241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.591341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.591418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.591496] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 917.664823] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.665027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.665126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.665319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.665491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.709422] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 918.259443] env[65106]: INFO networking_nsxv3.common.synchronization [None req-53ab8012-f311-49ed-b83a-8664595b6a09 None None] Enqueued Resource ID: 0f621842-0893-4c5a-a21f-c2fae5e4366c with Priority: HIGHEST for action port [ 918.260202] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f621842-0893-4c5a-a21f-c2fae5e4366c with Priority: HIGHEST for action port [ 918.260202] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f621842-0893-4c5a-a21f-c2fae5e4366c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.260331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f621842-0893-4c5a-a21f-c2fae5e4366c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.260331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f621842-0893-4c5a-a21f-c2fae5e4366c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.260746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f621842-0893-4c5a-a21f-c2fae5e4366c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.260746] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f621842-0893-4c5a-a21f-c2fae5e4366c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.767377] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f621842-0893-4c5a-a21f-c2fae5e4366c [ 918.767694] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.767694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.767694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.770842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.770842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.770842] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f621842-0893-4c5a-a21f-c2fae5e4366c already deleted. [ 918.770842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f621842-0893-4c5a-a21f-c2fae5e4366c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.865842] env[65106]: INFO networking_nsxv3.common.synchronization [req-dc931108-5e7f-4d40-a7ef-64ae812f798c req-78e95a87-f45f-4256-a372-2e27d608996f tempest-ListServerFiltersTestJSON-55285812 tempest-ListServerFiltersTestJSON-55285812-project-member] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 918.865842] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 918.865842] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.866043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.866043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.866316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.866395] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.866497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.866556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.866729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.866807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.866901] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.351652] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.351882] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.352041] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.352389] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.353150] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.353150] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.353150] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.353386] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.353424] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.355469] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.355469] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.355469] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.355469] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.355469] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.355469] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.355469] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.368913] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.369171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.369242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.369455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.369554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.369743] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.369842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.369945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.370074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.370074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.370269] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 already deleted. [ 919.370454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.376276] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.376450] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 919.376501] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.376647] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.376969] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-132c0278-17eb-4a7d-a2af-6624a32b952a taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.377152] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-132c0278-17eb-4a7d-a2af-6624a32b952a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.377501] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-132c0278-17eb-4a7d-a2af-6624a32b952a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.377668] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-132c0278-17eb-4a7d-a2af-6624a32b952a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.377814] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132c0278-17eb-4a7d-a2af-6624a32b952a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.730827] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 919.731713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.881048] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.881048] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.881425] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.881425] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.881502] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.881783] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 132c0278-17eb-4a7d-a2af-6624a32b952a not found, creating... [ 919.881959] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.882221] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.882960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.882960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.882960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.882960] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.883171] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.883171] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.883381] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.884582] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.884582] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 132c0278-17eb-4a7d-a2af-6624a32b952a is going to be created. [ 919.909500] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.909843] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.910089] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.910509] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.910868] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.911198] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-132c0278-17eb-4a7d-a2af-6624a32b952a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.628744] env[65106]: INFO networking_nsxv3.common.synchronization [req-dc931108-5e7f-4d40-a7ef-64ae812f798c req-931e7f21-d67f-42b5-a379-2cf9fc78fb05 service nova] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_rules [ 920.628926] env[65106]: INFO networking_nsxv3.common.synchronization [req-dc931108-5e7f-4d40-a7ef-64ae812f798c req-931e7f21-d67f-42b5-a379-2cf9fc78fb05 service nova] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 920.629070] env[65106]: INFO networking_nsxv3.common.synchronization [req-dc931108-5e7f-4d40-a7ef-64ae812f798c req-931e7f21-d67f-42b5-a379-2cf9fc78fb05 service nova] Enqueued Resource ID: 132c0278-17eb-4a7d-a2af-6624a32b952a with Priority: HIGHEST for action port [ 920.629639] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_rules [ 920.629780] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 920.629951] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 132c0278-17eb-4a7d-a2af-6624a32b952a with Priority: HIGHEST for action port [ 920.631341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.631481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.631547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.631808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.631893] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.633228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.633343] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.633412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.633591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.633739] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.633833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.633899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.638188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.638188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.638188] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.639166] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-132c0278-17eb-4a7d-a2af-6624a32b952a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.639166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-132c0278-17eb-4a7d-a2af-6624a32b952a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.639166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-132c0278-17eb-4a7d-a2af-6624a32b952a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.639346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-132c0278-17eb-4a7d-a2af-6624a32b952a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.639346] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('132c0278-17eb-4a7d-a2af-6624a32b952a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.647017] env[65106]: INFO networking_nsxv3.common.synchronization [None req-1694da04-74b1-4521-b423-2c087ee1437e None None] Enqueued Resource ID: f3aba80b-a9c9-4e52-aedb-665747e0d39a with Priority: HIGHEST for action port [ 920.647017] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3aba80b-a9c9-4e52-aedb-665747e0d39a with Priority: HIGHEST for action port [ 920.647161] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f3aba80b-a9c9-4e52-aedb-665747e0d39a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.647275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f3aba80b-a9c9-4e52-aedb-665747e0d39a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.647725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f3aba80b-a9c9-4e52-aedb-665747e0d39a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.648935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f3aba80b-a9c9-4e52-aedb-665747e0d39a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.648935] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f3aba80b-a9c9-4e52-aedb-665747e0d39a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.092221] env[65106]: INFO networking_nsxv3.common.synchronization [req-a0bb678b-1221-47f7-8de9-ab159d471c8b req-453a6dfb-7a28-45a9-8ea7-cae057d60e5d tempest-ListServerFiltersTestJSON-55285812 tempest-ListServerFiltersTestJSON-55285812-project-member] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 921.092835] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 921.098053] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.098053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.143675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.143675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.143675] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.144524] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 132c0278-17eb-4a7d-a2af-6624a32b952a with status ACTIVE [ 921.144826] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.144968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.145470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.145555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.145645] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.145940] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.146164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.146244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.146468] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.146548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.146839] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.147070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.147070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.147298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.147398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.147599] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 132c0278-17eb-4a7d-a2af-6624a32b952a is going to be updated. [ 921.153192] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f3aba80b-a9c9-4e52-aedb-665747e0d39a [ 921.153468] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.153662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.153735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.154012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.154140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.154285] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f3aba80b-a9c9-4e52-aedb-665747e0d39a already deleted. [ 921.154392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f3aba80b-a9c9-4e52-aedb-665747e0d39a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.178759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.178759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.178759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.178759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.178759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.178759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-132c0278-17eb-4a7d-a2af-6624a32b952a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.603029] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.603223] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.603306] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.603549] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.604350] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.604350] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.604350] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.604658] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.604658] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.604788] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.604917] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 921.604983] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 921.605119] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 921.605228] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 921.605330] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 921.605489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 921.629936] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 921.630674] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 921.630674] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 921.631365] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.632080] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-a6cbe344-126f-48d3-8609-0ba113c97213 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.632080] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-a6cbe344-126f-48d3-8609-0ba113c97213" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.632288] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-a6cbe344-126f-48d3-8609-0ba113c97213" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.632614] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-a6cbe344-126f-48d3-8609-0ba113c97213" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.632751] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6cbe344-126f-48d3-8609-0ba113c97213',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.654188] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.071717] env[65106]: INFO networking_nsxv3.common.synchronization [None req-3cf3ce05-4ba0-44d9-8553-200393d681d1 None None] Enqueued Resource ID: d1e799e3-3326-4693-846b-095cbda96105 with Priority: HIGHEST for action port [ 922.072408] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1e799e3-3326-4693-846b-095cbda96105 with Priority: HIGHEST for action port [ 922.072718] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1e799e3-3326-4693-846b-095cbda96105 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.072842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1e799e3-3326-4693-846b-095cbda96105" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.072934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1e799e3-3326-4693-846b-095cbda96105" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.073614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1e799e3-3326-4693-846b-095cbda96105" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.073758] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1e799e3-3326-4693-846b-095cbda96105',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.137113] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.137447] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.137584] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.137966] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.138195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.138374] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port a6cbe344-126f-48d3-8609-0ba113c97213 not found, creating... [ 922.138669] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.138894] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.139208] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.139578] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.139808] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.140272] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.141790] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.142241] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.142472] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.142619] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.142730] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: a6cbe344-126f-48d3-8609-0ba113c97213 is going to be created. [ 922.157314] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.157683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.157854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.158568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.158739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.158839] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be created. [ 922.171210] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.171485] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.171670] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.171975] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.175586] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.175586] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-a6cbe344-126f-48d3-8609-0ba113c97213" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.194274] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.194274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.194274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.194274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.194274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.202015] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: UNINITIALIZED for 2s [ 922.576134] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1e799e3-3326-4693-846b-095cbda96105 [ 922.576573] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.576823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.576823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.578208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.578307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.578408] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1e799e3-3326-4693-846b-095cbda96105 already deleted. [ 922.578493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1e799e3-3326-4693-846b-095cbda96105" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.898880] env[65106]: INFO networking_nsxv3.common.synchronization [req-a0bb678b-1221-47f7-8de9-ab159d471c8b req-c1f767b9-207d-4b45-a2f0-d785bb49ef95 service nova] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_rules [ 922.899082] env[65106]: INFO networking_nsxv3.common.synchronization [req-a0bb678b-1221-47f7-8de9-ab159d471c8b req-c1f767b9-207d-4b45-a2f0-d785bb49ef95 service nova] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 922.899258] env[65106]: INFO networking_nsxv3.common.synchronization [req-a0bb678b-1221-47f7-8de9-ab159d471c8b req-c1f767b9-207d-4b45-a2f0-d785bb49ef95 service nova] Enqueued Resource ID: a6cbe344-126f-48d3-8609-0ba113c97213 with Priority: HIGHEST for action port [ 922.899994] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_rules [ 922.900103] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 922.900268] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6cbe344-126f-48d3-8609-0ba113c97213 with Priority: HIGHEST for action port [ 922.900590] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.900700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.900903] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.900989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.901182] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6cbe344-126f-48d3-8609-0ba113c97213 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.901281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6cbe344-126f-48d3-8609-0ba113c97213" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.901381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6cbe344-126f-48d3-8609-0ba113c97213" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.901597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6cbe344-126f-48d3-8609-0ba113c97213" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.901718] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6cbe344-126f-48d3-8609-0ba113c97213',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.405022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6cbe344-126f-48d3-8609-0ba113c97213 with status ACTIVE [ 923.405022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.405022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.405022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.405022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.405022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.407358] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.407358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.407358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.407358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.407621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.408057] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.408712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.408712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.410182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.410182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.410182] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6cbe344-126f-48d3-8609-0ba113c97213 is going to be updated. [ 923.440251] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.440416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.440503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.440693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.440929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.441115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6cbe344-126f-48d3-8609-0ba113c97213" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.796694] env[65106]: INFO networking_nsxv3.common.synchronization [None req-29325bda-c09d-4c72-bcca-57bad766ba1b tempest-ServersTestManualDisk-279691729 tempest-ServersTestManualDisk-279691729-project-member] Enqueued Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_rules [ 923.797319] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_rules [ 923.797640] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.797760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.797826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.798130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.798197] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.932744] env[65106]: INFO networking_nsxv3.common.synchronization [None req-cde63145-bef9-437c-9a2b-abb7a96ea14f tempest-ServersTestManualDisk-279691729 tempest-ServersTestManualDisk-279691729-project-member] Enqueued Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_rules [ 923.933587] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_rules [ 923.934228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.934228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.013509] env[65106]: INFO networking_nsxv3.common.synchronization [None req-50538ebd-7c11-4ab2-8be2-cb601e0ccdf3 None None] Enqueued Resource ID: 30feed22-4cc4-48ee-93a0-b35bffd63a8f with Priority: HIGHEST for action port [ 924.014079] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30feed22-4cc4-48ee-93a0-b35bffd63a8f with Priority: HIGHEST for action port [ 924.014385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-30feed22-4cc4-48ee-93a0-b35bffd63a8f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.014506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-30feed22-4cc4-48ee-93a0-b35bffd63a8f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.014572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-30feed22-4cc4-48ee-93a0-b35bffd63a8f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.014821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-30feed22-4cc4-48ee-93a0-b35bffd63a8f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.014900] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('30feed22-4cc4-48ee-93a0-b35bffd63a8f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.214109] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 924.218301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.218504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.218738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.219059] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.219219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.219345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.219472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.219572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.219669] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.322500] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.322500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.322500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.322913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.322913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.322913] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 already deleted. [ 924.323167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.323329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.323744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.323847] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.518173] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 30feed22-4cc4-48ee-93a0-b35bffd63a8f [ 924.518651] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.518651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.518651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.518873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.519084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.519231] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:30feed22-4cc4-48ee-93a0-b35bffd63a8f already deleted. [ 924.519354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-30feed22-4cc4-48ee-93a0-b35bffd63a8f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.723323] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.846210] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.846210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.846210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.846210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.846210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.846210] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 already deleted. [ 924.846210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.226600] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.729726] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.730057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.730057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.730158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.730249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.730409] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 925.774143] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.774310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.774310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.774547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.774701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.788738] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 927.455600] env[65106]: INFO networking_nsxv3.common.synchronization [req-b3ec5ed2-88ad-47d0-8c8d-974be2db7205 req-dee0a0fe-4c75-4959-bc4b-fe0b383eb167 tempest-ServerActionsTestOtherB-878484751 tempest-ServerActionsTestOtherB-878484751-project-member] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 927.456644] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 927.457904] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.457904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.457904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.458112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.458550] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.458550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.458550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.458769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.458864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.458963] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.800831] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 927.801050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.801252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.803997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.803997] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.803997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.803997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.803997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.803997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.803997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.803997] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.803997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.804654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.804654] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.804654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.804790] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.805047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.805167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.805281] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.963261] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.963423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.963495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.963734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.963850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.964287] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.964397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.964463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.964737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.964835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.964951] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 928.004240] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.004445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.004445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.004663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.004934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.018463] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 928.304430] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.304685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.308399] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.812239] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.315680] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.315680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.315895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.316476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.316476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.316476] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 929.367904] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.367904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.367904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.367904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.367904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.379046] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 929.476787] env[65106]: INFO networking_nsxv3.common.synchronization [req-90338511-75f5-4a69-9b13-245b6bd7612f req-b3fc4ffd-b935-4749-bab8-2c134a4a377a tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 929.478995] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 929.479537] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.481025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.481025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.481025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.481025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.481025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.481025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.481025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.481025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.481025] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.730537] env[65106]: INFO networking_nsxv3.common.synchronization [req-9b5769bc-7b3e-4d07-b579-5631b5f7aa99 req-98158851-590d-4dec-aeca-1a89d4ef9d76 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 929.731477] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 929.731803] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.732191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.732284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.732484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.732785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.732898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.732935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.733114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.733201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.733394] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.982893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.984317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.984317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.984317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.984317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.984317] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.984317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.984317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.984317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.984317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.984317] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 930.017510] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.017510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.017510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.017510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.017510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.029160] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 930.029505] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a deletion is rescheduled due to dependency. [ 930.029505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.030516] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 930.069689] env[65106]: INFO networking_nsxv3.common.synchronization [req-042b37a4-a911-4cbc-b174-ff17f5d92f83 req-9f2847c9-2144-4591-a02b-1617ec58b66f tempest-ListServerFiltersTestJSON-55285812 tempest-ListServerFiltersTestJSON-55285812-project-member] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 930.070271] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 930.070660] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.070767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.235437] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.235652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.235723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.235951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.236116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.236261] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.236359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.236421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.236576] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.236655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.236741] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 930.275731] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.275914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.275914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.276193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.276330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.306417] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 930.544436] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-383 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.544631] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.544754] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.545065] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.545321] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.545478] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.545591] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.545807] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.545946] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.547913] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.548066] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.548219] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.548347] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.548464] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.548569] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.548704] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.570036] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.570192] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.570335] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.570502] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-383" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.570823] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-51523d08-d0d5-4072-8488-cf2f27e3f178 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.571407] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-51523d08-d0d5-4072-8488-cf2f27e3f178" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.571407] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-51523d08-d0d5-4072-8488-cf2f27e3f178" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.571578] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-51523d08-d0d5-4072-8488-cf2f27e3f178" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.571608] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51523d08-d0d5-4072-8488-cf2f27e3f178',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.074414] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.074899] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.074899] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.075138] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.075315] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.075527] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 51523d08-d0d5-4072-8488-cf2f27e3f178 not found, creating... [ 931.075799] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.075960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.076090] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.076369] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.076507] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.076832] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.077093] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.077201] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.077398] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.077534] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.077733] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 51523d08-d0d5-4072-8488-cf2f27e3f178 is going to be created. [ 931.109297] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.109686] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.109686] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.109894] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.110216] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.110393] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-51523d08-d0d5-4072-8488-cf2f27e3f178" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.390229] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 931.390229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.390229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.390229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.390229] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.390530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.390530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.390623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.390623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.390687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.391255] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.391255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.391255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.391255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.391398] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.391398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.391479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.391543] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.391615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.391693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.391776] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.392864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.392990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.393160] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.393266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.393323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.393541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.393600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.393753] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.856238] env[65106]: INFO networking_nsxv3.common.synchronization [req-042b37a4-a911-4cbc-b174-ff17f5d92f83 req-698307e1-f105-45be-b488-59dcf1ff4fec service nova] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_rules [ 931.856238] env[65106]: INFO networking_nsxv3.common.synchronization [req-042b37a4-a911-4cbc-b174-ff17f5d92f83 req-698307e1-f105-45be-b488-59dcf1ff4fec service nova] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 931.856238] env[65106]: INFO networking_nsxv3.common.synchronization [req-042b37a4-a911-4cbc-b174-ff17f5d92f83 req-698307e1-f105-45be-b488-59dcf1ff4fec service nova] Enqueued Resource ID: 51523d08-d0d5-4072-8488-cf2f27e3f178 with Priority: HIGHEST for action port [ 931.856238] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_rules [ 931.856238] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 931.856238] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51523d08-d0d5-4072-8488-cf2f27e3f178 with Priority: HIGHEST for action port [ 931.856238] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.856238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.856238] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.856238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.856238] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-51523d08-d0d5-4072-8488-cf2f27e3f178 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.856980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51523d08-d0d5-4072-8488-cf2f27e3f178" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.857239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51523d08-d0d5-4072-8488-cf2f27e3f178" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.857769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51523d08-d0d5-4072-8488-cf2f27e3f178" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.857987] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51523d08-d0d5-4072-8488-cf2f27e3f178',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.895777] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4453797-05cb-4758-bad7-725b4ea09d52: rpc.has_security_group_logging(os_id): False [ 931.896894] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.915146] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.915300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.915370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.915574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.915661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.915914] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.916036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.916102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.916252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.916328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.916510] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.916603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.916664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.916802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.916898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.917095] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.917188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.917249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.917389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.917462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.917544] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be created. [ 931.981303] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.982044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.982044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.982044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.982189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.993125] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 932.046662] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 932.047041] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 deletion is rescheduled due to dependency. [ 932.047314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.321144] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 932.321461] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 932.321461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.362175] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 51523d08-d0d5-4072-8488-cf2f27e3f178 with status ACTIVE [ 932.362996] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.363105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.363201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.364346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.364429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.364620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.364753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.364783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.364950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.365061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.365267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.365504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.365611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.365639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.365717] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 51523d08-d0d5-4072-8488-cf2f27e3f178 is going to be updated. [ 932.398776] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.398776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.398776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.399090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.399346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.399590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51523d08-d0d5-4072-8488-cf2f27e3f178" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.399941] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.414355] env[65106]: INFO networking_nsxv3.common.synchronization [req-ff0ce74c-d7fc-43f4-8dda-1df12d849c21 req-925601c5-023d-4320-adbb-9f888f65009c tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_members [ 932.415017] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_members [ 932.415226] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.415380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.415448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.415701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.415859] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.415955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.416135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.416207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.416257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.416347] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.808053] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.808053] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.808053] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.808506] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.808506] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.808647] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.808756] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.808994] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.809297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.809364] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.809439] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.809540] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.809746] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.809746] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.809892] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.809951] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.850026] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.850026] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.850026] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.850026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.850026] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-ae25a691-fbb4-4645-8087-6b0962299ab2 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.850026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-ae25a691-fbb4-4645-8087-6b0962299ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.850026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-ae25a691-fbb4-4645-8087-6b0962299ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.850026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-ae25a691-fbb4-4645-8087-6b0962299ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.850026] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae25a691-fbb4-4645-8087-6b0962299ab2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.902765] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.903044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.903044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.903207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.903300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.903394] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 932.918191] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.918396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.918396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.918600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.918685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.918871] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.918966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.919038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.919185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.919257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.919346] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 already deleted. [ 932.919404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.931383] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.931535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.931570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.931755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.931895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.940887] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 933.092835] env[65106]: INFO networking_nsxv3.common.synchronization [req-48f42542-6fe9-40f1-9b14-d6eb7c105952 req-98e710b2-12c0-4433-8b93-ab031a4ca8b5 tempest-MigrationsAdminTest-232602271 tempest-MigrationsAdminTest-232602271-project-member] Enqueued Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 933.093413] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 49f44a93-5686-4d9d-984b-4efb2550596c with Priority: HIGHEST for action security_group_members [ 933.093766] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-49f44a93-5686-4d9d-984b-4efb2550596c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.093897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.093962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.094318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.094449] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.094534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.094586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.094743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.094870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.094967] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('49f44a93-5686-4d9d-984b-4efb2550596c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.353553] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.353986] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.354140] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.354842] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.355032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.355303] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port ae25a691-fbb4-4645-8087-6b0962299ab2 not found, creating... [ 933.355629] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.355847] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.355984] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.356346] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.356543] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.356931] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.357158] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.357288] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.357539] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.357681] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.357830] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: ae25a691-fbb4-4645-8087-6b0962299ab2 is going to be created. [ 933.380659] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.380917] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.381099] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.381474] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.381727] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.382021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-ae25a691-fbb4-4645-8087-6b0962299ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.600656] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.600946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.601323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.601414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.632342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.632646] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.632794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.632863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.633142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.633509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.633656] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c is going to be updated. [ 933.709166] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.709429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.709429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.709641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.709793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.723885] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: IN_PROGRESS for 2s [ 934.005239] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ef66aa10-8472-4c9d-8684-565d0d860e66 tempest-ServerRescueNegativeTestJSON-745464586 tempest-ServerRescueNegativeTestJSON-745464586-project-member] Enqueued Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_rules [ 934.005883] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_rules [ 934.006253] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.006495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.006619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.006878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.006986] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.009863] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 934.010252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.010425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.010722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.010776] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.130107] env[65106]: INFO networking_nsxv3.common.synchronization [req-ff0ce74c-d7fc-43f4-8dda-1df12d849c21 req-58ff1fbd-adf1-4657-ab24-7998455683bc service nova] Enqueued Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_rules [ 934.130307] env[65106]: INFO networking_nsxv3.common.synchronization [req-ff0ce74c-d7fc-43f4-8dda-1df12d849c21 req-58ff1fbd-adf1-4657-ab24-7998455683bc service nova] Enqueued Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_members [ 934.130595] env[65106]: INFO networking_nsxv3.common.synchronization [req-ff0ce74c-d7fc-43f4-8dda-1df12d849c21 req-58ff1fbd-adf1-4657-ab24-7998455683bc service nova] Enqueued Resource ID: ae25a691-fbb4-4645-8087-6b0962299ab2 with Priority: HIGHEST for action port [ 934.131057] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_rules [ 934.131185] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_members [ 934.131284] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae25a691-fbb4-4645-8087-6b0962299ab2 with Priority: HIGHEST for action port [ 934.131551] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.133998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.133998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.133998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.133998] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.133998] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.133998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.133998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.133998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.133998] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.133998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.133998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.134943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.134943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.134943] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.135387] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ae25a691-fbb4-4645-8087-6b0962299ab2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.135561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ae25a691-fbb4-4645-8087-6b0962299ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.135661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ae25a691-fbb4-4645-8087-6b0962299ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.135791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ae25a691-fbb4-4645-8087-6b0962299ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.135869] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ae25a691-fbb4-4645-8087-6b0962299ab2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.160187] env[65106]: INFO networking_nsxv3.common.synchronization [None req-be48e8d2-5801-4ff2-be11-844898c11379 tempest-ServerRescueNegativeTestJSON-745464586 tempest-ServerRescueNegativeTestJSON-745464586-project-member] Enqueued Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_rules [ 934.161208] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_rules [ 934.161561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.161707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.512865] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.513281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.537026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.537026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.537026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.537026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.537026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.537026] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 already deleted. [ 934.537026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.537026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.537026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.537026] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.638473] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.638634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.638795] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.639759] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ae25a691-fbb4-4645-8087-6b0962299ab2 with status ACTIVE [ 934.640013] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.640142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.640236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.640462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.640548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.640718] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.640816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.640879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.641182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.641270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.641522] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.641677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.641719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.641877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.641963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.642102] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ae25a691-fbb4-4645-8087-6b0962299ab2 is going to be updated. [ 934.666430] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.666603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.666684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.666936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.667118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.667310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ae25a691-fbb4-4645-8087-6b0962299ab2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.952434] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 934.952744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.952928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.953290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.953366] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.953486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.953552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.953701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.953781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.953883] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.057979] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.058164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.058217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.058413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.058495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.058606] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 already deleted. [ 935.058689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.144874] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.456124] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.654416] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.654416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.654416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.654416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.654416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.654416] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 is going to be created. [ 935.680506] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.680506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.680506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.680506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.680762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.696941] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4372f393-06e7-4930-9ab6-1687d050de71 in Status: UNINITIALIZED for 2s [ 935.737696] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 49f44a93-5686-4d9d-984b-4efb2550596c in Status: SUCCESS [ 935.737696] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 49f44a93-5686-4d9d-984b-4efb2550596c deletion is rescheduled due to dependency. [ 935.737696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-49f44a93-5686-4d9d-984b-4efb2550596c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.958558] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.462212] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.462370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.462447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.462673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.462765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.462865] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 936.501600] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.501756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.501855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.502086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.502249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.515614] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 937.705224] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4372f393-06e7-4930-9ab6-1687d050de71 in Status: SUCCESS [ 937.706298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.710670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.711044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.712681] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.712681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.712681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.712681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.712681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.712681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.712681] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.215170] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.528208] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 938.528398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.528578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.528792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.528983] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.529116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.529189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.529335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.529412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.529497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.529590] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.717889] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4372f393-06e7-4930-9ab6-1687d050de71: rpc.has_security_group_logging(os_id): False [ 938.740437] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.741506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.741506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.741506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.741506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.741506] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.741506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.741506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.741506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.741893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.741893] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 is going to be created. [ 938.809822] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.809822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.809822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.809822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.809822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.821892] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4372f393-06e7-4930-9ab6-1687d050de71 in Status: IN_PROGRESS for 2s [ 939.034703] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.035775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.035775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.035775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.036095] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.036202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.036324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.036588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.036799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.036908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.037233] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.037368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.037450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.037688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.037900] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.038064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.038193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.038371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.038459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.038565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.038676] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.162425] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 939.162524] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 939.541100] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4453797-05cb-4758-bad7-725b4ea09d52: rpc.has_security_group_logging(os_id): False [ 939.568605] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.568812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.568848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.569092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.569207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.569461] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.569539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.569606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.569859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.569859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.570057] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.570150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.570222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.570366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.570452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.570634] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.570723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.570796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.570938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.571070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.571146] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 939.665432] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.665573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.665725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.666112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.666112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.679511] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 940.834462] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4372f393-06e7-4930-9ab6-1687d050de71 in Status: SUCCESS [ 940.834863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.718826] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 941.718826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.718826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.718826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.719162] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.222024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.222419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.222419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.222902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.223393] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.223545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.224408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.224408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.224408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.224408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.224408] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.727239] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.727504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.727689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.727943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.728165] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.728276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.728353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.728567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.728811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.728811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.728946] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.729144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.729254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.729435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.729651] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.729785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.729944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.730142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.730296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.730442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.730606] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.233137] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4453797-05cb-4758-bad7-725b4ea09d52: rpc.has_security_group_logging(os_id): False [ 943.252591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.252774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.252842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.253137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.253236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.253483] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.253587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.253731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.253893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.253973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.254244] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.254354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.254417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.254589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.254807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.255014] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.255162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.255279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.255447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.255554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.255633] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 943.327777] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.327777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.327777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.327777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.328091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.343216] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 943.409963] env[65106]: INFO networking_nsxv3.common.synchronization [None req-4edd134a-e460-4d8f-a2fd-053f31f8fb1e None None] Enqueued Resource ID: 59c7c41d-f9cb-442c-b722-991e81ec625e with Priority: HIGHEST for action port [ 943.410212] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59c7c41d-f9cb-442c-b722-991e81ec625e with Priority: HIGHEST for action port [ 943.410975] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-59c7c41d-f9cb-442c-b722-991e81ec625e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.410975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59c7c41d-f9cb-442c-b722-991e81ec625e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.410975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59c7c41d-f9cb-442c-b722-991e81ec625e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.411168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59c7c41d-f9cb-442c-b722-991e81ec625e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.411168] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59c7c41d-f9cb-442c-b722-991e81ec625e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.504687] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.504830] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.504928] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.505318] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.505666] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.505838] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.505956] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.509376] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.509555] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.509804] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.509991] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.510189] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.510760] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.510760] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.510760] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.511666] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.540743] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.540743] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.540743] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.540743] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.541024] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.541024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.541157] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.541413] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.541569] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.916807] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 59c7c41d-f9cb-442c-b722-991e81ec625e [ 943.917052] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.917190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.918087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.918087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.918087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.918087] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:59c7c41d-f9cb-442c-b722-991e81ec625e already deleted. [ 943.918087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59c7c41d-f9cb-442c-b722-991e81ec625e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.046378] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.046588] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.046652] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.046931] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.047126] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.047424] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.047582] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.047813] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.048053] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.048193] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.048481] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.048635] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.048748] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.048954] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.049434] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.049434] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 is going to be updated. [ 944.075748] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.075982] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.076597] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.077104] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.077547] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.077815] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.879787] env[65106]: INFO networking_nsxv3.common.synchronization [req-c958dce2-4add-4a73-9384-d3897007bae7 req-e429c97a-7031-49e0-9675-036de1a9a2f4 service nova] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_rules [ 944.880126] env[65106]: INFO networking_nsxv3.common.synchronization [req-c958dce2-4add-4a73-9384-d3897007bae7 req-e429c97a-7031-49e0-9675-036de1a9a2f4 service nova] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_members [ 944.880318] env[65106]: INFO networking_nsxv3.common.synchronization [req-c958dce2-4add-4a73-9384-d3897007bae7 req-e429c97a-7031-49e0-9675-036de1a9a2f4 service nova] Enqueued Resource ID: fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 with Priority: HIGHEST for action port [ 944.880868] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_rules [ 944.881014] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_members [ 944.885125] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 with Priority: HIGHEST for action port [ 944.885501] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.885638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.885708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.885942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.886249] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.887369] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.887493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.887592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.887733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.887913] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.888016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.888080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.888225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.888314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.888409] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.889290] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.890235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.890343] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.890534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.890618] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.385135] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 945.385374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.393682] env[65106]: INFO networking_nsxv3.common.synchronization [None req-e779bfe1-388a-4f18-803e-03b8f3b3ea83 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_rules [ 945.393682] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.397229] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.397229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.397229] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_rules [ 945.397229] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 with status ACTIVE [ 945.397229] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.397229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.397229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.397677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.397677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.397677] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.397844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.397844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.398145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.398145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.399114] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.399114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.399114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.399834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.400081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.402240] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8 is going to be updated. [ 945.403231] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.403887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.404074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.404413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.406020] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.428761] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.428954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.429041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.429292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.429394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.429563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb5b3a98-5bcd-4f47-b0ec-ff43acae3cf8" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.677068] env[65106]: INFO networking_nsxv3.common.synchronization [None req-643ce07f-8ede-4737-b288-6f09355eecf5 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_rules [ 945.677662] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_rules [ 945.678748] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.678939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.897806] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.942409] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.942602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.942651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.942866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.942964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.943095] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb already deleted. [ 945.943177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.943712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.943890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.944066] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.400612] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.400863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.400930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.401209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.401294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.401392] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 is going to be updated. [ 946.484035] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.484272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.484272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.484509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.484558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.484643] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb already deleted. [ 946.484734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.507166] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.507868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.507868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.507868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.507868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.532749] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: IN_PROGRESS for 2s [ 946.559902] env[65106]: INFO networking_nsxv3.common.synchronization [None req-05c25040-4ab3-4db0-a81e-3b8231d7c1b0 None None] Enqueued Resource ID: 72f9ec80-0ec6-431e-98db-d80ee10f655f with Priority: HIGHEST for action port [ 946.560462] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72f9ec80-0ec6-431e-98db-d80ee10f655f with Priority: HIGHEST for action port [ 946.560855] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-72f9ec80-0ec6-431e-98db-d80ee10f655f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.561032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72f9ec80-0ec6-431e-98db-d80ee10f655f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.561125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72f9ec80-0ec6-431e-98db-d80ee10f655f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.561398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72f9ec80-0ec6-431e-98db-d80ee10f655f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.561961] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72f9ec80-0ec6-431e-98db-d80ee10f655f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.066553] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 72f9ec80-0ec6-431e-98db-d80ee10f655f [ 947.066553] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.066553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.066553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.066553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.066553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.066553] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:72f9ec80-0ec6-431e-98db-d80ee10f655f already deleted. [ 947.066553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72f9ec80-0ec6-431e-98db-d80ee10f655f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.322925] env[65106]: INFO networking_nsxv3.common.synchronization [req-94290ded-3cc3-4091-96cf-4b771e0418d3 req-4ca41b18-f250-40be-ad96-205f430a4416 tempest-FloatingIPsAssociationTestJSON-1367400107 tempest-FloatingIPsAssociationTestJSON-1367400107-project-member] Enqueued Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 947.323508] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 947.323808] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.323930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.323995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.324817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.324993] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.325125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.325285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.325484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.325586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.325722] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.709966] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-457 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.710211] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-457" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.710319] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-457" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.710591] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-457" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.710852] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.711015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.713293] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.713839] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.714054] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.714356] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.714476] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.714590] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.714706] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.714818] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.714922] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.715089] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.736433] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.736646] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.736740] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.736925] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-457" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.737276] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.737456] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.737578] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.737916] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.738070] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd4cfd98-4c64-4138-9d0d-82b71dbb6dee',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.828260] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.168125] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0fce0a1c-60b2-40e9-939a-1047f6b9ee50 None None] Enqueued Resource ID: 123e22f5-8072-4991-aaaa-1da7db826e52 with Priority: HIGHEST for action port [ 948.168418] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 123e22f5-8072-4991-aaaa-1da7db826e52 with Priority: HIGHEST for action port [ 948.168549] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-123e22f5-8072-4991-aaaa-1da7db826e52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.168672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-123e22f5-8072-4991-aaaa-1da7db826e52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.168738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-123e22f5-8072-4991-aaaa-1da7db826e52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.168976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-123e22f5-8072-4991-aaaa-1da7db826e52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.169101] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('123e22f5-8072-4991-aaaa-1da7db826e52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.240308] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.240525] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.241091] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.241091] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.241091] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.241327] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port cd4cfd98-4c64-4138-9d0d-82b71dbb6dee not found, creating... [ 948.241507] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.242116] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.242116] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.242116] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.242279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.242490] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.242586] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.242703] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.242904] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.243051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.243194] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: cd4cfd98-4c64-4138-9d0d-82b71dbb6dee is going to be created. [ 948.266208] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.266626] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.266837] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.267249] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.267605] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.267918] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.330219] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.547365] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: SUCCESS [ 948.547589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.547762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.547990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.548195] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.548309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.548365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.548518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.548594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.548678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.548771] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.673508] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 123e22f5-8072-4991-aaaa-1da7db826e52 [ 948.673508] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.673508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.673508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.673508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.673508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.673508] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:123e22f5-8072-4991-aaaa-1da7db826e52 already deleted. [ 948.673508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-123e22f5-8072-4991-aaaa-1da7db826e52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.832432] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.832432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.832432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.832687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.832922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.833051] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 is going to be updated. [ 948.867921] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.868092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.868132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.868350] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.868502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.880958] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: IN_PROGRESS for 2s [ 948.900444] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b1b3169a-9dec-48a1-b3fa-74aebfbc974b None None] Enqueued Resource ID: 70493335-1527-4a4b-9b52-c50fea09f5a3 with Priority: HIGHEST for action port [ 948.901642] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70493335-1527-4a4b-9b52-c50fea09f5a3 with Priority: HIGHEST for action port [ 948.902021] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-70493335-1527-4a4b-9b52-c50fea09f5a3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.902185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70493335-1527-4a4b-9b52-c50fea09f5a3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.902263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70493335-1527-4a4b-9b52-c50fea09f5a3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.902520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70493335-1527-4a4b-9b52-c50fea09f5a3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.902598] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70493335-1527-4a4b-9b52-c50fea09f5a3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.039074] env[65106]: INFO networking_nsxv3.common.synchronization [req-94290ded-3cc3-4091-96cf-4b771e0418d3 req-5718e9ed-1dfd-4326-80bb-d3dbe64a30c3 service nova] Enqueued Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_rules [ 949.039255] env[65106]: INFO networking_nsxv3.common.synchronization [req-94290ded-3cc3-4091-96cf-4b771e0418d3 req-5718e9ed-1dfd-4326-80bb-d3dbe64a30c3 service nova] Enqueued Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 949.039384] env[65106]: INFO networking_nsxv3.common.synchronization [req-94290ded-3cc3-4091-96cf-4b771e0418d3 req-5718e9ed-1dfd-4326-80bb-d3dbe64a30c3 service nova] Enqueued Resource ID: cd4cfd98-4c64-4138-9d0d-82b71dbb6dee with Priority: HIGHEST for action port [ 949.041467] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_rules [ 949.041467] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 949.041467] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd4cfd98-4c64-4138-9d0d-82b71dbb6dee with Priority: HIGHEST for action port [ 949.042569] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.042569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.042569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.042569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.042569] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.044618] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.044716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.045252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.045986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.045986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.045986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.045986] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd4cfd98-4c64-4138-9d0d-82b71dbb6dee',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.051229] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.404513] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 70493335-1527-4a4b-9b52-c50fea09f5a3 [ 949.404805] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.404938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.405040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.405333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.405419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.406034] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:70493335-1527-4a4b-9b52-c50fea09f5a3 already deleted. [ 949.406034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70493335-1527-4a4b-9b52-c50fea09f5a3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.549512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.549809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.552378] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd4cfd98-4c64-4138-9d0d-82b71dbb6dee with status ACTIVE [ 949.552378] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.552510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.552510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.553506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.553506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.553506] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.553506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.553506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.553506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.553506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.553506] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.553856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.553856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.553856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.553856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.553976] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd4cfd98-4c64-4138-9d0d-82b71dbb6dee is going to be updated. [ 949.555564] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898: rpc.has_security_group_logging(os_id): False [ 949.580327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.580523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.580523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.580739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.580822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.581076] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.581180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.581239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.581383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.581451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.581678] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 is going to be updated. [ 949.594079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.594304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.594304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.594644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.594644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.594799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd4cfd98-4c64-4138-9d0d-82b71dbb6dee" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.605687] env[65106]: INFO networking_nsxv3.common.synchronization [req-c473cadf-01de-4c85-a043-03e489a45b9c req-7222d6a5-f36d-479e-a2d1-7997ac6034d8 tempest-FloatingIPsAssociationNegativeTestJSON-1218894049 tempest-FloatingIPsAssociationNegativeTestJSON-1218894049-project-member] Enqueued Resource ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c with Priority: HIGHEST for action security_group_members [ 949.606819] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c with Priority: HIGHEST for action security_group_members [ 949.606866] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.606985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.607054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.607614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.607776] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.607872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.607931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.608311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.608311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.608311] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f36e318-4a87-4b4f-9bd9-1b549e42f93c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.673555] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.673555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.673555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.673555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.673555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.717035] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: IN_PROGRESS for 2s [ 950.025271] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-46 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.025271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-46" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.025271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-46" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.025271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-46" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.025271] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.025271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.025271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.025271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.025854] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.026357] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.026357] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.026357] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.026499] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.026627] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.026972] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.026972] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.048562] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.048562] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.048562] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.048768] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-46" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.049013] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-d6a8f637-cc0f-495a-8671-091361f00b87 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.049194] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-d6a8f637-cc0f-495a-8671-091361f00b87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.049598] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-d6a8f637-cc0f-495a-8671-091361f00b87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.049845] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-d6a8f637-cc0f-495a-8671-091361f00b87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.049980] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a8f637-cc0f-495a-8671-091361f00b87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.110658] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.110658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.110846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.112406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.112579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.114280] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.114280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.114434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.114673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.114673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.114751] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c already deleted. [ 950.114849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.553139] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.554917] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.554917] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.554917] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.554917] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.554917] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port d6a8f637-cc0f-495a-8671-091361f00b87 not found, creating... [ 950.555225] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.555598] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.555598] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.555670] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.555792] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.556089] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.556260] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.556373] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.556758] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.556758] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.556864] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: d6a8f637-cc0f-495a-8671-091361f00b87 is going to be created. [ 950.591978] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.594026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.594026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.594026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.594026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.594026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-d6a8f637-cc0f-495a-8671-091361f00b87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.689403] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ed907932-128d-4cb8-be68-cdf34e784440 None None] Enqueued Resource ID: d021eb01-c4a4-409d-a1d0-e56ac059e68e with Priority: HIGHEST for action port [ 950.689403] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d021eb01-c4a4-409d-a1d0-e56ac059e68e with Priority: HIGHEST for action port [ 950.689403] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d021eb01-c4a4-409d-a1d0-e56ac059e68e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.689403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d021eb01-c4a4-409d-a1d0-e56ac059e68e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.689740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d021eb01-c4a4-409d-a1d0-e56ac059e68e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.690156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d021eb01-c4a4-409d-a1d0-e56ac059e68e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.690372] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d021eb01-c4a4-409d-a1d0-e56ac059e68e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.894445] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: SUCCESS [ 950.894670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.894852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.895095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.895303] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.895433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.895494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.895658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.895741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.895841] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.193332] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d021eb01-c4a4-409d-a1d0-e56ac059e68e [ 951.193446] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.193683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.193817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.194242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.194368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.194552] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d021eb01-c4a4-409d-a1d0-e56ac059e68e already deleted. [ 951.194721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d021eb01-c4a4-409d-a1d0-e56ac059e68e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.270252] env[65106]: INFO networking_nsxv3.common.synchronization [None req-580909b5-45fa-4047-b7a8-eeecbdfc05d8 None None] Enqueued Resource ID: 43436548-a057-4b94-87e4-74371a0c55f7 with Priority: HIGHEST for action port [ 951.270839] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43436548-a057-4b94-87e4-74371a0c55f7 with Priority: HIGHEST for action port [ 951.271176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-43436548-a057-4b94-87e4-74371a0c55f7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.271322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43436548-a057-4b94-87e4-74371a0c55f7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.271444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43436548-a057-4b94-87e4-74371a0c55f7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.271620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43436548-a057-4b94-87e4-74371a0c55f7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.271693] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43436548-a057-4b94-87e4-74371a0c55f7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.400054] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.441179] env[65106]: INFO networking_nsxv3.common.synchronization [req-c473cadf-01de-4c85-a043-03e489a45b9c req-df0040cb-cfb1-4cc1-b33a-7dc9f12df5ab service nova] Enqueued Resource ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c with Priority: HIGHEST for action security_group_rules [ 951.441179] env[65106]: INFO networking_nsxv3.common.synchronization [req-c473cadf-01de-4c85-a043-03e489a45b9c req-df0040cb-cfb1-4cc1-b33a-7dc9f12df5ab service nova] Enqueued Resource ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c with Priority: HIGHEST for action security_group_members [ 951.441179] env[65106]: INFO networking_nsxv3.common.synchronization [req-c473cadf-01de-4c85-a043-03e489a45b9c req-df0040cb-cfb1-4cc1-b33a-7dc9f12df5ab service nova] Enqueued Resource ID: d6a8f637-cc0f-495a-8671-091361f00b87 with Priority: HIGHEST for action port [ 951.443642] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c with Priority: HIGHEST for action security_group_rules [ 951.443895] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c with Priority: HIGHEST for action security_group_members [ 951.444326] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6a8f637-cc0f-495a-8671-091361f00b87 with Priority: HIGHEST for action port [ 951.445877] env[65106]: INFO networking_nsxv3.common.synchronization [req-4ac99e4f-774b-4c82-bfbd-73720a77e663 req-3b2f4745-443f-45c0-98ba-c525e2c3aceb tempest-ServersTestManualDisk-279691729 tempest-ServersTestManualDisk-279691729-project-member] Enqueued Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_members [ 951.447285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f36e318-4a87-4b4f-9bd9-1b549e42f93c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.447560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.447772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.448104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.448280] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f36e318-4a87-4b4f-9bd9-1b549e42f93c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.449324] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.449578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.449748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.450055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.450321] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.450571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.450741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.450992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.451207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.451404] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f36e318-4a87-4b4f-9bd9-1b549e42f93c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.452933] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6a8f637-cc0f-495a-8671-091361f00b87 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.454021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6a8f637-cc0f-495a-8671-091361f00b87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.454021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6a8f637-cc0f-495a-8671-091361f00b87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.454021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6a8f637-cc0f-495a-8671-091361f00b87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.454021] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6a8f637-cc0f-495a-8671-091361f00b87',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.455160] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_members [ 951.458408] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.458408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.458408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.458408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.458408] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.458408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.458408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.458408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.458981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.459254] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.734579] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: SUCCESS [ 951.734579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.777253] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 43436548-a057-4b94-87e4-74371a0c55f7 [ 951.777253] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.777253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.777253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.777253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.777253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.777253] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:43436548-a057-4b94-87e4-74371a0c55f7 already deleted. [ 951.777253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43436548-a057-4b94-87e4-74371a0c55f7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.902412] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.959391] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f36e318-4a87-4b4f-9bd9-1b549e42f93c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.960465] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.960570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.960730] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6a8f637-cc0f-495a-8671-091361f00b87 with status ACTIVE [ 951.960884] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.960985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.961061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.961262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.961346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.961510] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.961604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.961664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.961813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.961888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.962079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.962189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.962247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.962471] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.962605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.962658] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6a8f637-cc0f-495a-8671-091361f00b87 is going to be updated. [ 951.967363] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.967363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.967363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.967363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.967667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.967667] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.967667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.967774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.967870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.967905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.967990] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 already deleted. [ 951.968706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.969721] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-805 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.969860] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-805" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.969981] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-805" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.970266] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-805" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.970517] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.970671] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.970778] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.971015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.971168] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.971319] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.971428] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.971535] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.971641] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.971744] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.971847] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.971974] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.999286] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.999454] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.999587] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.999760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-805" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.000660] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-3fd6fe95-6571-450a-9a38-763720e0c053 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.000660] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-3fd6fe95-6571-450a-9a38-763720e0c053" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.000660] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-3fd6fe95-6571-450a-9a38-763720e0c053" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.000896] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-3fd6fe95-6571-450a-9a38-763720e0c053" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.000896] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd6fe95-6571-450a-9a38-763720e0c053',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.005953] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.005953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.005953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.005953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.005953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.005953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6a8f637-cc0f-495a-8671-091361f00b87" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.406959] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.406959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.406959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.408032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.408032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.408032] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 is going to be updated. [ 952.443176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.443335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.443393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.443593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.443771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.455975] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: IN_PROGRESS for 2s [ 952.465816] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f36e318-4a87-4b4f-9bd9-1b549e42f93c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.503508] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.503689] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.503768] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.504604] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.504811] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.504981] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 3fd6fe95-6571-450a-9a38-763720e0c053 not found, creating... [ 952.505351] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.505530] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.505690] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.506174] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.506342] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.506806] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.507094] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.507300] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.507570] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.507818] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.508043] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 3fd6fe95-6571-450a-9a38-763720e0c053 is going to be created. [ 952.546047] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.546047] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.546047] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.546047] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.546606] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.546606] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-3fd6fe95-6571-450a-9a38-763720e0c053" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.973275] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.973566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.973566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.974692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.974692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.974692] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c is going to be created. [ 953.007072] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.007317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.007514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.007661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.007890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.021916] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c in Status: UNINITIALIZED for 2s [ 953.290233] env[65106]: INFO networking_nsxv3.common.synchronization [req-4ac99e4f-774b-4c82-bfbd-73720a77e663 req-2e8a76d8-06b7-4a3a-81ba-c8051a59f27c service nova] Enqueued Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_rules [ 953.290440] env[65106]: INFO networking_nsxv3.common.synchronization [req-4ac99e4f-774b-4c82-bfbd-73720a77e663 req-2e8a76d8-06b7-4a3a-81ba-c8051a59f27c service nova] Enqueued Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_members [ 953.290590] env[65106]: INFO networking_nsxv3.common.synchronization [req-4ac99e4f-774b-4c82-bfbd-73720a77e663 req-2e8a76d8-06b7-4a3a-81ba-c8051a59f27c service nova] Enqueued Resource ID: 3fd6fe95-6571-450a-9a38-763720e0c053 with Priority: HIGHEST for action port [ 953.291184] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_rules [ 953.291350] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_members [ 953.291442] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd6fe95-6571-450a-9a38-763720e0c053 with Priority: HIGHEST for action port [ 953.291716] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.291841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.291937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.292236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.292334] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.294232] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.294486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.294554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.294748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.294915] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.295026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.295098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.295257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.295346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.295441] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.296283] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd6fe95-6571-450a-9a38-763720e0c053 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.296381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd6fe95-6571-450a-9a38-763720e0c053" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.296448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd6fe95-6571-450a-9a38-763720e0c053" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.296596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd6fe95-6571-450a-9a38-763720e0c053" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.296671] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd6fe95-6571-450a-9a38-763720e0c053',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.794965] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.795208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.798765] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.799943] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fd6fe95-6571-450a-9a38-763720e0c053 with status ACTIVE [ 953.800507] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.800507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.800507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.800705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.800814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.801080] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.801217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.801307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.801569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.801678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.801961] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.802147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.802258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.802469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.802559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.802684] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fd6fe95-6571-450a-9a38-763720e0c053 is going to be updated. [ 953.831558] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.831558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.831730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.831841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.832023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.832240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd6fe95-6571-450a-9a38-763720e0c053" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.038717] env[65106]: INFO networking_nsxv3.common.synchronization [req-0fab4240-e83b-4412-bb23-ac38075d95de req-4ef1d619-0791-4353-8741-1f1cfc29bd9b tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 954.039469] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 954.039826] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.039972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.040067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.040307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.040488] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.040616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.040685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.040865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.040978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.041087] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.305288] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.470037] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: SUCCESS [ 954.470224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.470929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.470929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.471196] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.471313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.471369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.471749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.471829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.471942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.472168] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.489543] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-759 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.489543] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.489749] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.489830] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.490635] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.490635] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.490635] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.490635] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.490895] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.491774] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.491774] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.491774] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.491774] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.492060] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.492060] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.492293] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.537336] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.537609] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.537822] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.538102] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-759" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.538598] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.538873] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.539233] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.539731] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.539939] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ef987d4-d7f9-4580-a3ca-f8b6baefec8d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.543886] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.544115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.544323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.545917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.546067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.546377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.546529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.546642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.546912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.547200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.547200] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 954.579172] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.579393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.579474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.579755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.581868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.593199] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 954.810332] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.810492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.810588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.811040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.811040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.811040] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 is going to be created. [ 954.838513] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.838696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.838784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.839059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.839274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.852580] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 in Status: UNINITIALIZED for 2s [ 954.974651] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.974895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.974995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.975324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.975563] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.975727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.975896] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.976164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.976280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.976381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.976538] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.976653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.976706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.976866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.977020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.977112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.977170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.977370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.977463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.977572] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.977737] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.033728] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c in Status: SUCCESS [ 955.033985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.034161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.034413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.034655] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.034823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.034823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.034998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.035103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.035188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.035284] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f36e318-4a87-4b4f-9bd9-1b549e42f93c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.043445] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.045028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.045028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.045028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.045028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.045028] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 0ef987d4-d7f9-4580-a3ca-f8b6baefec8d not found, creating... [ 955.045028] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.045028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.045028] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.045402] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.045482] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.045830] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.045997] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.046132] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.046351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.046488] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.046662] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 0ef987d4-d7f9-4580-a3ca-f8b6baefec8d is going to be created. [ 955.081652] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.081652] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.081652] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.081652] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.081652] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.081652] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.480246] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a791c8c3-0f7e-4205-8d3d-977dc22a4708: rpc.has_security_group_logging(os_id): False [ 955.507598] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.507840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.507923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.508172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.508268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.508508] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.508645] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.508728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.508908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.509041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.509542] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.509770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.509770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.509992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.510219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.510606] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.510721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.510788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.510979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.511093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.511188] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 is going to be updated. [ 955.537718] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.537934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.538035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.538305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.538593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.538721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.538805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.539070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.539164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.539260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.539426] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.539588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.539688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.539867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.540212] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.540378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.540449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.540654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.540932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.540970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.541152] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f36e318-4a87-4b4f-9bd9-1b549e42f93c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.595050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.595050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.595050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.595050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.595397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.613223] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: IN_PROGRESS for 2s [ 955.848231] env[65106]: INFO networking_nsxv3.common.synchronization [req-0fab4240-e83b-4412-bb23-ac38075d95de req-21f22279-b985-4b9a-9cb8-1bddd50d1166 service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 955.848231] env[65106]: INFO networking_nsxv3.common.synchronization [req-0fab4240-e83b-4412-bb23-ac38075d95de req-21f22279-b985-4b9a-9cb8-1bddd50d1166 service nova] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 955.850020] env[65106]: INFO networking_nsxv3.common.synchronization [req-0fab4240-e83b-4412-bb23-ac38075d95de req-21f22279-b985-4b9a-9cb8-1bddd50d1166 service nova] Enqueued Resource ID: 0ef987d4-d7f9-4580-a3ca-f8b6baefec8d with Priority: HIGHEST for action port [ 955.850020] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_rules [ 955.850020] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 955.850020] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ef987d4-d7f9-4580-a3ca-f8b6baefec8d with Priority: HIGHEST for action port [ 955.850445] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.851295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.851295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.851555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.851555] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.852796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.852796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.853148] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.853316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.853497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.853707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.853836] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ef987d4-d7f9-4580-a3ca-f8b6baefec8d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.043341] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f36e318-4a87-4b4f-9bd9-1b549e42f93c: rpc.has_security_group_logging(os_id): False [ 956.068748] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.069142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.069142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.069142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.069244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.069677] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.069677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.069677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.069884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.069884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.069939] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.070116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.070181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.070337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.070405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.070601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.070698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.071066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.071066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.071066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.071066] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c is going to be created. [ 956.150086] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.150306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.150412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.150780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.151084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.173726] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c in Status: IN_PROGRESS for 2s [ 956.357499] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.357499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.357823] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ef987d4-d7f9-4580-a3ca-f8b6baefec8d with status ACTIVE [ 956.357878] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.357993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.358481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.358481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.358481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.358664] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.358775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.358986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.359472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.359653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.359878] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.359984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.360085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.360255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.360348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.360479] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ef987d4-d7f9-4580-a3ca-f8b6baefec8d is going to be updated. [ 956.413052] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.413052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.413498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.414824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.414824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.414824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ef987d4-d7f9-4580-a3ca-f8b6baefec8d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.624952] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 956.625166] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 deletion is rescheduled due to dependency. [ 956.625338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.625603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.625883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.626088] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.626209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.626277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.626444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.626529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.626627] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.871811] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 in Status: SUCCESS [ 956.871811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.871811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.871811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.871811] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.871811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.871811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.871811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.871811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.871811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.871811] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.129502] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.377130] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.631420] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: SUCCESS [ 957.631621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.631913] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.881832] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4451dd0e-c25c-4af6-bb10-62fc99478e20: rpc.has_security_group_logging(os_id): False [ 957.907777] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.907991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.908096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.908353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.908532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.908886] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.909090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.909090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.909279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.909362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.909449] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 is going to be created. [ 958.018180] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.018390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.018511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.018816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.019142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.045667] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 in Status: IN_PROGRESS for 2s [ 958.135534] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.136716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.136716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.136716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.136716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.136716] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 958.196810] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c in Status: SUCCESS [ 958.197122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.207266] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.207266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.207266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.207266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.207266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.224624] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 960.064769] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 in Status: SUCCESS [ 960.065804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.239302] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 4s [ 960.852060] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 960.852060] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 962.253143] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 962.253542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.253725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.254096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.254416] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.254628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.254741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.255024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.255102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.255287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.255469] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.758568] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.758857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.758964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.759260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.759605] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.759787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.759925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.760188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.760347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.760522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.760799] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.760954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.761090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.761349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.761619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.761791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.761938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.762197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.762373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.762547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.762721] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.266876] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4b9f28-129e-4614-b2d6-9173d8122416: rpc.has_security_group_logging(os_id): False [ 963.287717] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.287856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.287926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.288172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.288292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.289067] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.289264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.289347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.289611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.289740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.289981] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.290105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.290167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.290335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.290435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.290738] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.290881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.290950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.291117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.291195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.291285] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 963.380101] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.380327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.380327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.380633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.380819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.396061] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 965.419877] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 965.420217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.683105] env[65106]: INFO networking_nsxv3.common.synchronization [req-38bda24d-a1ac-401b-bf83-c84b8d148a6b req-8c864cbf-99ad-4ee6-8536-99a7dd969b99 tempest-ServerRescueNegativeTestJSON-745464586 tempest-ServerRescueNegativeTestJSON-745464586-project-member] Enqueued Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_members [ 965.683704] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_members [ 965.687094] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.687268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.687341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.687653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.687806] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.687912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.687976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.688151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.688237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.688372] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.136313] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.136313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.136559] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.137017] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.137017] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.137172] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.137298] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.137548] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.137670] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.138314] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.138314] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 966.138314] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 966.138314] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 966.138479] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 966.138479] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 966.138595] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 966.164637] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 966.164949] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 966.165167] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 966.165395] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-144" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.165846] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.166069] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.166227] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.166639] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.166808] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f9f61d2-fe12-4e21-b382-aba3ca479dd1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.354144] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.354387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.354451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.354693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.354784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.354989] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.355280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.355341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.355524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.355602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.355692] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 already deleted. [ 966.355770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.669237] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.669760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.669760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.670243] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.670243] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.670360] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 8f9f61d2-fe12-4e21-b382-aba3ca479dd1 not found, creating... [ 966.670645] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.670791] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.670915] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.671174] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.671305] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.671584] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.671750] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.671876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.672095] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.672241] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.672385] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 8f9f61d2-fe12-4e21-b382-aba3ca479dd1 is going to be created. [ 966.696126] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.696345] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.696470] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.697102] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.697300] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.697569] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.349750] env[65106]: INFO networking_nsxv3.common.synchronization [req-ff582802-c135-4b18-8a48-d38b334f3368 req-68168a09-bdea-4435-b52b-313889de94cd tempest-FloatingIPsAssociationTestJSON-1367400107 tempest-FloatingIPsAssociationTestJSON-1367400107-project-member] Enqueued Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 967.350430] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 967.350851] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.351223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.351223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.351406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.351619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.351750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.351843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.352173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.352300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.352428] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.426252] env[65106]: INFO networking_nsxv3.common.synchronization [req-38bda24d-a1ac-401b-bf83-c84b8d148a6b req-44bdde05-e878-452d-8bd9-d873b0025d7e service nova] Enqueued Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_rules [ 967.426584] env[65106]: INFO networking_nsxv3.common.synchronization [req-38bda24d-a1ac-401b-bf83-c84b8d148a6b req-44bdde05-e878-452d-8bd9-d873b0025d7e service nova] Enqueued Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_members [ 967.426584] env[65106]: INFO networking_nsxv3.common.synchronization [req-38bda24d-a1ac-401b-bf83-c84b8d148a6b req-44bdde05-e878-452d-8bd9-d873b0025d7e service nova] Enqueued Resource ID: 8f9f61d2-fe12-4e21-b382-aba3ca479dd1 with Priority: HIGHEST for action port [ 967.427243] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_rules [ 967.427319] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_members [ 967.427386] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f9f61d2-fe12-4e21-b382-aba3ca479dd1 with Priority: HIGHEST for action port [ 967.427683] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.427808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.427933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.428145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.428230] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.429193] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.429303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.429367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.429544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.429680] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.429841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.429841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.429994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.430088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.430238] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.430914] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.431509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.431621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.433073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.433196] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f9f61d2-fe12-4e21-b382-aba3ca479dd1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.856250] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.936435] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.937128] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.937128] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.941301] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8f9f61d2-fe12-4e21-b382-aba3ca479dd1 with status ACTIVE [ 967.941301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.941301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.941301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.941301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.941301] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8f9f61d2-fe12-4e21-b382-aba3ca479dd1 is going to be updated. [ 967.991791] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.992079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.992079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.992352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.992537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.992706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f9f61d2-fe12-4e21-b382-aba3ca479dd1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.358852] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.443756] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.862689] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.863029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.863029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.863100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.863985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.863985] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 is going to be updated. [ 968.901348] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.901532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.901595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.901843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.901942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.913506] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: IN_PROGRESS for 2s [ 968.948444] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.948444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.948444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.948444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.948444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.948444] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 is going to be created. [ 968.991175] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.991328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.991394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.991610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.991769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.003963] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 in Status: UNINITIALIZED for 2s [ 971.087406] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: SUCCESS [ 971.087815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.092620] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 in Status: SUCCESS [ 971.092877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.092877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.093280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.093737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.093737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.093737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.093977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.093977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.094082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.094178] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.345168] env[65106]: INFO networking_nsxv3.common.synchronization [req-aad275c0-0736-4cd9-9853-ccd8d87681a7 req-272e8cf6-f19c-4874-bcee-e9ef8a62bd2b tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_members [ 971.346117] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_members [ 971.346975] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-faa319fa-2be7-45e6-acc2-0f5f031e93fb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.347351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.347566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.347948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.348582] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.349301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.349301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.349301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.349678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.350461] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.597388] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.780475] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.780859] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.781045] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.781560] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.782455] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.782455] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.786910] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.786910] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.786910] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.786910] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.786910] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.786910] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.787132] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.787132] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.787352] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.787553] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.821709] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.821709] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.821709] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.821709] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.822158] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-dcc22966-dff8-4cf8-8e22-720df21f0420 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.822158] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-dcc22966-dff8-4cf8-8e22-720df21f0420" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.822158] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-dcc22966-dff8-4cf8-8e22-720df21f0420" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.823043] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-dcc22966-dff8-4cf8-8e22-720df21f0420" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.823043] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcc22966-dff8-4cf8-8e22-720df21f0420',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.854144] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.854420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.854525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.854879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.855053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.855383] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.855548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.855647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.855895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.856032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.856170] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb already deleted. [ 971.856293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.101211] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68b6b1dd-52ab-4ef3-8749-07f0a0035702: rpc.has_security_group_logging(os_id): False [ 972.126250] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.126250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.126250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.126250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.126250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.126250] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.126250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.126929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.126929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.126929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.126929] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 is going to be created. [ 972.278161] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.278414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.278414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.278603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.278784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.292877] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 in Status: IN_PROGRESS for 2s [ 972.326907] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.326907] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.326907] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.326907] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.326907] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.326907] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port dcc22966-dff8-4cf8-8e22-720df21f0420 not found, creating... [ 972.326907] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.326907] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.326907] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.327519] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.327519] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.327519] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.327638] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.328185] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.328185] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.328185] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.328408] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: dcc22966-dff8-4cf8-8e22-720df21f0420 is going to be created. [ 972.353474] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.353824] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.353904] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.354169] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.354497] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.354982] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-dcc22966-dff8-4cf8-8e22-720df21f0420" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.086144] env[65106]: INFO networking_nsxv3.common.synchronization [req-aad275c0-0736-4cd9-9853-ccd8d87681a7 req-050a83fc-8b4a-4257-b935-1893409aee8c service nova] Enqueued Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_rules [ 973.086378] env[65106]: INFO networking_nsxv3.common.synchronization [req-aad275c0-0736-4cd9-9853-ccd8d87681a7 req-050a83fc-8b4a-4257-b935-1893409aee8c service nova] Enqueued Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_members [ 973.086533] env[65106]: INFO networking_nsxv3.common.synchronization [req-aad275c0-0736-4cd9-9853-ccd8d87681a7 req-050a83fc-8b4a-4257-b935-1893409aee8c service nova] Enqueued Resource ID: dcc22966-dff8-4cf8-8e22-720df21f0420 with Priority: HIGHEST for action port [ 973.087184] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_rules [ 973.087373] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_members [ 973.087491] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcc22966-dff8-4cf8-8e22-720df21f0420 with Priority: HIGHEST for action port [ 973.087866] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.087932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.087967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.088167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.088309] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.089628] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-faa319fa-2be7-45e6-acc2-0f5f031e93fb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.092632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.092632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.092632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.092632] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.092632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.092632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.092632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.092632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.092632] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.093264] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcc22966-dff8-4cf8-8e22-720df21f0420 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.095190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcc22966-dff8-4cf8-8e22-720df21f0420" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.095190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcc22966-dff8-4cf8-8e22-720df21f0420" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.095190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcc22966-dff8-4cf8-8e22-720df21f0420" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.095190] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcc22966-dff8-4cf8-8e22-720df21f0420',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.599038] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.599038] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-faa319fa-2be7-45e6-acc2-0f5f031e93fb taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.599038] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcc22966-dff8-4cf8-8e22-720df21f0420 with status ACTIVE [ 973.599038] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.599038] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.599038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.606603] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.606603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.606603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.606603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.606603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.606603] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcc22966-dff8-4cf8-8e22-720df21f0420 is going to be updated. [ 973.650616] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.650842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.651197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.651480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.651688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.651884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcc22966-dff8-4cf8-8e22-720df21f0420" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.835617] env[65106]: INFO networking_nsxv3.common.synchronization [req-25e19100-3dec-4ba2-80c7-76104b45f302 req-9233d2e6-9715-4af6-a6a9-d82100ae0f94 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 973.841129] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 973.841129] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.841376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.841376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.842033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.842033] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.842033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.842033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.842337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.846176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.846382] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.098258] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.322021] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-248 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.322021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-248" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.322154] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-248" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.322531] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-248" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.322986] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.323226] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.323403] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.323739] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.323934] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.324248] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.324484] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 974.324643] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 974.324792] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 974.324969] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 974.325134] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 974.325361] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 974.327602] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 in Status: SUCCESS [ 974.327854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.349292] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.349516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.349607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.349872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.350034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.350197] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.350356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.350411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.350673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.350823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.350971] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 already deleted. [ 974.351123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.352234] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 974.352407] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 974.352547] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 974.352727] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-248" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.353077] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-940a255c-c8f1-43d2-ae1f-5bbfa4875527 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.353279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.353400] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.353781] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.353978] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940a255c-c8f1-43d2-ae1f-5bbfa4875527',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.600564] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.600980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.600980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.601140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.601240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.601356] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb is going to be created. [ 974.648070] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.648287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.648369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.648585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.648743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.660138] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb in Status: UNINITIALIZED for 2s [ 974.856803] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.857067] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.857211] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.857663] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.857663] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.857838] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 940a255c-c8f1-43d2-ae1f-5bbfa4875527 not found, creating... [ 974.858075] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.858239] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.858353] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.858569] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.858700] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.858982] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.859150] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.859259] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.859456] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.859586] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.859865] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 is going to be created. [ 974.885325] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.885705] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.885852] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.886181] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.886431] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.886692] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.649828] env[65106]: INFO networking_nsxv3.common.synchronization [req-25e19100-3dec-4ba2-80c7-76104b45f302 req-28c45419-6c86-454c-8288-2c750d726873 service nova] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_rules [ 975.650102] env[65106]: INFO networking_nsxv3.common.synchronization [req-25e19100-3dec-4ba2-80c7-76104b45f302 req-28c45419-6c86-454c-8288-2c750d726873 service nova] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 975.650221] env[65106]: INFO networking_nsxv3.common.synchronization [req-25e19100-3dec-4ba2-80c7-76104b45f302 req-28c45419-6c86-454c-8288-2c750d726873 service nova] Enqueued Resource ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with Priority: HIGHEST for action port [ 975.650939] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_rules [ 975.654174] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 975.654174] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with Priority: HIGHEST for action port [ 975.654956] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.654956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.654956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.655370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.655466] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.657747] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.657747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.657747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.658623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.658623] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.658623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.658623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.658801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.658801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.659033] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.662115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-940a255c-c8f1-43d2-ae1f-5bbfa4875527 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.662834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.662834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.663699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.663699] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940a255c-c8f1-43d2-ae1f-5bbfa4875527',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.880862] env[65106]: INFO networking_nsxv3.common.synchronization [req-b24e4c16-5bd8-4c33-8ee0-157b1cccd9b8 req-763cfbdb-38aa-42b1-b33c-1264d8d778dc tempest-FloatingIPsAssociationNegativeTestJSON-1218894049 tempest-FloatingIPsAssociationNegativeTestJSON-1218894049-project-member] Enqueued Resource ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c with Priority: HIGHEST for action security_group_members [ 975.881434] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c with Priority: HIGHEST for action security_group_members [ 975.881747] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.881866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.881933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.883166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.883343] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.883465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.883535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.883790] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.883879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.883943] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f36e318-4a87-4b4f-9bd9-1b549e42f93c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.158635] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.159170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.167278] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with status ACTIVE [ 976.167278] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.167278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.167278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.167278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.167278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.168045] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.168045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.168045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.170022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.170022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.170022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.170022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.170022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.170022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.170022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.170022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 is going to be updated. [ 976.170879] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.194105] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.194105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.194105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.194105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.194416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.194416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.312704] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b68bba92-5ccd-41db-9a92-eac22571aa32 None None] Enqueued Resource ID: f9d175ff-8aec-4b7b-aefa-7eded12abbb4 with Priority: HIGHEST for action port [ 976.313461] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d175ff-8aec-4b7b-aefa-7eded12abbb4 with Priority: HIGHEST for action port [ 976.313770] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9d175ff-8aec-4b7b-aefa-7eded12abbb4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.313893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9d175ff-8aec-4b7b-aefa-7eded12abbb4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.314476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9d175ff-8aec-4b7b-aefa-7eded12abbb4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.314476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9d175ff-8aec-4b7b-aefa-7eded12abbb4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.314476] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9d175ff-8aec-4b7b-aefa-7eded12abbb4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.386467] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.386467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.386467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.386651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.386651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.386949] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.387067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.387067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.387184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.387256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.387339] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c is going to be updated. [ 976.434707] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.434884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.434982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.435371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.435550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.448029] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c in Status: IN_PROGRESS for 2s [ 976.672323] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb in Status: SUCCESS [ 976.672323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.672323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.672323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.672323] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.672323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.672323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.673283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.673283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.673283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.673283] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.674489] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.710280] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f6c53e4-af6f-4d9c-b175-523f18abcd80 req-e42667cd-2599-40ac-8918-6f66db98543c tempest-ListServerFiltersTestJSON-55285812 tempest-ListServerFiltersTestJSON-55285812-project-member] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 976.710811] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 976.711184] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.712320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.712638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.712991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.713201] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.713311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.713377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.713595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.713699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.713779] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.820203] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9d175ff-8aec-4b7b-aefa-7eded12abbb4 [ 976.820203] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.820203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.820203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.820386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.820386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.820462] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9d175ff-8aec-4b7b-aefa-7eded12abbb4 already deleted. [ 976.820535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9d175ff-8aec-4b7b-aefa-7eded12abbb4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.179683] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.183024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.183024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.183024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.183024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.183024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.183024] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be created. [ 977.217033] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.218571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.219211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.219211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.220416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.220416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.235208] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: UNINITIALIZED for 2s [ 977.464796] env[65106]: INFO networking_nsxv3.common.synchronization [req-807d3f46-1e12-4ab3-95ef-9bd0c688832d req-abcb2ae9-4c3d-42df-9ff6-9629f6022cd8 tempest-ServersNegativeTestJSON-2085709392 tempest-ServersNegativeTestJSON-2085709392-project-member] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 977.467616] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 977.467616] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.467616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.467616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.467616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.467616] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.467616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.467616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.467616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.467616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.467616] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.688280] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for faa319fa-2be7-45e6-acc2-0f5f031e93fb: rpc.has_security_group_logging(os_id): False [ 977.707209] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.707209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.707209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.707667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.707667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.707667] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.707873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.707873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.707973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.708037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.708143] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb is going to be created. [ 977.727413] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.869112] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.869266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.869338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.869558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.869719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.886834] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.886834] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.886834] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.886993] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.887214] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.887377] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.887494] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.887734] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.887921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.888342] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.888342] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.888342] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.888486] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.888486] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.890035] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.890035] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.890454] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb in Status: IN_PROGRESS for 2s [ 977.917047] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.917229] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.917369] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.917597] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.917865] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-102e6ba6-09b7-4909-9fc3-d15768428dc6 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.918052] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.918172] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.918512] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.918653] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('102e6ba6-09b7-4909-9fc3-d15768428dc6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.970293] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.970573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.970573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.970738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.970835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.971081] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.971202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.971264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.971833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.972026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.972151] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff already deleted. [ 977.972358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.229972] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.230171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.230259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.230579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.230706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.230816] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 978.273803] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.274304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.274304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.274304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.274442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.289943] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 978.420787] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.421131] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.421329] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.421694] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.421900] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.422583] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 102e6ba6-09b7-4909-9fc3-d15768428dc6 not found, creating... [ 978.422583] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.422734] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.422905] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.425324] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.425665] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.426274] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.426993] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.427246] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.427587] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.427810] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.428040] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 102e6ba6-09b7-4909-9fc3-d15768428dc6 is going to be created. [ 978.449205] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.449431] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.449559] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.449847] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.450123] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.450373] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.470061] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c in Status: SUCCESS [ 978.470245] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f36e318-4a87-4b4f-9bd9-1b549e42f93c deletion is rescheduled due to dependency. [ 978.471907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f36e318-4a87-4b4f-9bd9-1b549e42f93c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.640265] env[65106]: INFO networking_nsxv3.common.synchronization [None req-6dfd0b4b-3779-4893-a3a4-2a9b768346b0 None None] Enqueued Resource ID: 1cdf87c5-b59b-446d-89f5-674530f35262 with Priority: HIGHEST for action port [ 978.640905] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cdf87c5-b59b-446d-89f5-674530f35262 with Priority: HIGHEST for action port [ 978.641678] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cdf87c5-b59b-446d-89f5-674530f35262 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.641897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cdf87c5-b59b-446d-89f5-674530f35262" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.642047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cdf87c5-b59b-446d-89f5-674530f35262" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.642423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cdf87c5-b59b-446d-89f5-674530f35262" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.642575] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cdf87c5-b59b-446d-89f5-674530f35262',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.147396] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cdf87c5-b59b-446d-89f5-674530f35262 [ 979.148300] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.148300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.148300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.148300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.148452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.148452] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cdf87c5-b59b-446d-89f5-674530f35262 already deleted. [ 979.148893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cdf87c5-b59b-446d-89f5-674530f35262" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.241093] env[65106]: INFO networking_nsxv3.common.synchronization [req-807d3f46-1e12-4ab3-95ef-9bd0c688832d req-4621ca8d-d54e-49c4-b067-b3c0dc4f0dd3 service nova] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_rules [ 979.241266] env[65106]: INFO networking_nsxv3.common.synchronization [req-807d3f46-1e12-4ab3-95ef-9bd0c688832d req-4621ca8d-d54e-49c4-b067-b3c0dc4f0dd3 service nova] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 979.241428] env[65106]: INFO networking_nsxv3.common.synchronization [req-807d3f46-1e12-4ab3-95ef-9bd0c688832d req-4621ca8d-d54e-49c4-b067-b3c0dc4f0dd3 service nova] Enqueued Resource ID: 102e6ba6-09b7-4909-9fc3-d15768428dc6 with Priority: HIGHEST for action port [ 979.242020] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_rules [ 979.242166] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 979.242266] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e6ba6-09b7-4909-9fc3-d15768428dc6 with Priority: HIGHEST for action port [ 979.242627] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.242768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.242803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.243063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.243160] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.244315] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.244569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.244666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.244798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.244947] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.245051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.245107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.245244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.245431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.245599] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.246389] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-102e6ba6-09b7-4909-9fc3-d15768428dc6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.246490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.246550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.246712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.246801] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('102e6ba6-09b7-4909-9fc3-d15768428dc6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.250873] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: UNINITIALIZED for 4s [ 979.749391] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.751091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.751091] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.751091] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 102e6ba6-09b7-4909-9fc3-d15768428dc6 with status ACTIVE [ 979.751091] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.751091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.751091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.751570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.751570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.751570] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.751691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.751691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.752439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.756266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.756425] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.757461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.757461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.757461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.757660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.757660] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 102e6ba6-09b7-4909-9fc3-d15768428dc6 is going to be updated. [ 979.787132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.787272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.787668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.787668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.787668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.787820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.913904] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb in Status: SUCCESS [ 979.914242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.259934] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.302499] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 980.302821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.765973] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.766256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.766333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.766612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.766715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.766837] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be created. [ 980.799522] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.799746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.799746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.799941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.800144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.813120] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: UNINITIALIZED for 2s [ 981.262439] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: SUCCESS [ 981.262439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.262439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.262785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.262785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.262874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.262916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.263057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.263134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.263216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.263305] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.464371] env[65106]: INFO networking_nsxv3.common.synchronization [req-58883142-ddc2-4700-bec1-6de91ac2d731 req-3db0c9a8-0a9d-471a-9af2-42d4de7f2f8b tempest-ImagesTestJSON-1766198419 tempest-ImagesTestJSON-1766198419-project-member] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 981.465074] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGHEST for action security_group_members [ 981.465390] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.465528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.465602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.465806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.467154] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.467305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.467376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.467555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.467661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.467758] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.766298] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.766525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.766525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.766825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.767173] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.767173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.767173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.767390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.767439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.767529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.767682] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.767776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.767837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.767999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.768177] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.768276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.768334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.768476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.768553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.768635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.768725] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.799548] env[65106]: INFO networking_nsxv3.common.synchronization [req-08e15c37-c166-4135-a993-0e7a2d94bc79 req-f33a07b8-406b-49b0-8020-8aa459f833a8 tempest-AttachVolumeTestJSON-98661006 tempest-AttachVolumeTestJSON-98661006-project-member] Enqueued Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_members [ 981.800168] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGHEST for action security_group_members [ 981.800484] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-611ce8e9-468b-46ff-b93b-ebf52e6cce82 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.800610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.800691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.800865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.801315] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.801954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.801954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.801954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.801954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.801954] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.971336] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.971438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.971488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.971705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.971803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.972028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.972136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.972207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.972357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.972462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.972563] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be updated. [ 982.020974] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.021198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.021287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.021459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.021620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.039246] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: IN_PROGRESS for 2s [ 982.271627] env[65106]: INFO networking_nsxv3.common.synchronization [req-765a56b2-2515-40d0-bda8-c92d3c4783bc req-a487069a-8a3b-42eb-a33c-114e5d3b0029 tempest-ServerActionsTestOtherB-878484751 tempest-ServerActionsTestOtherB-878484751-project-member] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 982.271974] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23fe2875-1973-4bdd-9d70-ecf412917573: rpc.has_security_group_logging(os_id): False [ 982.273351] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 982.273750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.273818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.273855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.274067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.274225] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.274348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.274453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.275219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.275219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.275219] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.306693] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.306987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.307119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.307601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.307692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.307989] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.308138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.308207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.308467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.308549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.308641] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 is going to be updated. [ 982.312021] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.312242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.312317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.314620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.314620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.314620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.314620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.315288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.315288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.315288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.315288] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be created. [ 982.377395] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.377531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.377593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.377785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.377933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.390227] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 in Status: IN_PROGRESS for 2s [ 982.434154] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.434428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.434428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.434654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.434804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.456316] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: IN_PROGRESS for 2s [ 982.664044] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-522 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.664044] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.664044] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.664804] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.665221] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.665561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.665798] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.669045] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.669045] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.669045] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.669045] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.669045] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.669045] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.669045] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.669045] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.669045] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.686931] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.687060] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 982.687184] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.687300] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.687653] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.688123] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.688320] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.688685] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.688784] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d2d25ab-ab9d-4293-aeff-3a3b422711c5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.777373] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.777678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.777678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.777801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.777891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.778108] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.778208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.778269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.778414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.778489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.778573] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 982.823835] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.823835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.824101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.824152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.824289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.829862] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 982.830091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.830533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.830627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.830998] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.831107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.831107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.831269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.831386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.831464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.831562] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.842851] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 983.192265] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.192373] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.192535] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.192871] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.193135] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.193348] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 2d2d25ab-ab9d-4293-aeff-3a3b422711c5 not found, creating... [ 983.193769] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.194015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.194254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.194622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.194869] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.195300] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.195570] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.195783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.196046] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.196195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.196343] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 2d2d25ab-ab9d-4293-aeff-3a3b422711c5 is going to be created. [ 983.219227] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.219570] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.219790] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.220181] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.220541] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.220856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.334706] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.335175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.335175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.335255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.335596] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.335726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.335794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.336233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.336233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.336233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.336461] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.336530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.336579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.336749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.336904] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.337028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.337104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.337258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.337317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.337431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.337535] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.842256] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff: rpc.has_security_group_logging(os_id): False [ 983.866153] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.866292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.866411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.866621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.866761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.866901] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.866997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.867073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.867220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.867295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.867479] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.867581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.867639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.867812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.867919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.869453] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.869884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.869884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.869884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.873128] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.873273] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be created. [ 983.963792] env[65106]: INFO networking_nsxv3.common.synchronization [req-765a56b2-2515-40d0-bda8-c92d3c4783bc req-7a3e6995-543d-4ae2-92ed-8bc31450a53b service nova] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 983.963981] env[65106]: INFO networking_nsxv3.common.synchronization [req-765a56b2-2515-40d0-bda8-c92d3c4783bc req-7a3e6995-543d-4ae2-92ed-8bc31450a53b service nova] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 983.964166] env[65106]: INFO networking_nsxv3.common.synchronization [req-765a56b2-2515-40d0-bda8-c92d3c4783bc req-7a3e6995-543d-4ae2-92ed-8bc31450a53b service nova] Enqueued Resource ID: 2d2d25ab-ab9d-4293-aeff-3a3b422711c5 with Priority: HIGHEST for action port [ 983.964895] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 983.965057] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 983.965243] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d2d25ab-ab9d-4293-aeff-3a3b422711c5 with Priority: HIGHEST for action port [ 983.965828] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.966097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.966261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.966619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.967556] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.968281] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.968506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.968966] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.969291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.969470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.969824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.970035] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d2d25ab-ab9d-4293-aeff-3a3b422711c5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.973278] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.973278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.973477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.974227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.974227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.034832] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: IN_PROGRESS for 2s [ 984.079863] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 in Status: SUCCESS [ 984.080077] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 deletion is rescheduled due to dependency. [ 984.080158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.402181] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 in Status: SUCCESS [ 984.402558] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 deletion is rescheduled due to dependency. [ 984.402558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.467866] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: SUCCESS [ 984.468110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.472663] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.472824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.477158] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d2d25ab-ab9d-4293-aeff-3a3b422711c5 with status ACTIVE [ 984.477347] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.477487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.477574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.477774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.477857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.478049] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.478149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.478206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.478353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.478426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.478601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.478692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.478746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.478882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.478952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.479045] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d2d25ab-ab9d-4293-aeff-3a3b422711c5 is going to be updated. [ 984.526590] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.526829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.526917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.527200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.527370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.527616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d2d25ab-ab9d-4293-aeff-3a3b422711c5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.854469] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 984.854647] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a deletion is rescheduled due to dependency. [ 984.854765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.854934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.855178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.855363] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.855479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.855560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.855731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.855830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.855902] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.144290] env[65106]: INFO networking_nsxv3.common.synchronization [req-8f0e53e0-d521-47f3-a788-b1d4ddd4bd20 req-e3242acd-bd5e-4913-bb1a-165a5dad12c0 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 985.144978] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 985.145354] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.145733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.145733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.145911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.146081] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.146180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.146260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.146409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.146493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.146646] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.358326] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.621786] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.622179] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.622179] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.622481] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.623631] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.623631] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.623631] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.623631] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.623631] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.623631] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.623895] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.623895] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.624066] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.624264] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.624466] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.624674] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.649909] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.650335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.650489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.650639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.650734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.650949] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.651076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.651139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.651288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.651362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.651447] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 985.661405] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.661572] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.661752] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.661951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.662506] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-c2a8c269-bb5f-47b7-a1be-b8282556bb39 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.662688] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-c2a8c269-bb5f-47b7-a1be-b8282556bb39" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.662808] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-c2a8c269-bb5f-47b7-a1be-b8282556bb39" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.663174] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-c2a8c269-bb5f-47b7-a1be-b8282556bb39" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.663463] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2a8c269-bb5f-47b7-a1be-b8282556bb39',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.686805] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.687011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.687086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.687301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.687446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.697180] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 985.861497] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.049052] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 986.049265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.166704] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.166996] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.167155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.167463] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.167618] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.167794] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port c2a8c269-bb5f-47b7-a1be-b8282556bb39 not found, creating... [ 986.168096] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.168276] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.168394] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.168651] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.168802] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.169127] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.169293] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.169417] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.169657] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.169791] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.169941] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: c2a8c269-bb5f-47b7-a1be-b8282556bb39 is going to be created. [ 986.192693] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.192952] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.193117] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.193482] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.193748] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.194180] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-c2a8c269-bb5f-47b7-a1be-b8282556bb39" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.364157] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.364372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.364440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.366039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.366039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.366257] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 986.407097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.407325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.407325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.407853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.418990] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 986.915509] env[65106]: INFO networking_nsxv3.common.synchronization [req-8f0e53e0-d521-47f3-a788-b1d4ddd4bd20 req-1e9edf7a-037f-4086-8c5e-e2c1de260ec6 service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 986.916232] env[65106]: INFO networking_nsxv3.common.synchronization [req-8f0e53e0-d521-47f3-a788-b1d4ddd4bd20 req-1e9edf7a-037f-4086-8c5e-e2c1de260ec6 service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 986.916232] env[65106]: INFO networking_nsxv3.common.synchronization [req-8f0e53e0-d521-47f3-a788-b1d4ddd4bd20 req-1e9edf7a-037f-4086-8c5e-e2c1de260ec6 service nova] Enqueued Resource ID: c2a8c269-bb5f-47b7-a1be-b8282556bb39 with Priority: HIGHEST for action port [ 986.916501] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 986.918531] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 986.918531] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2a8c269-bb5f-47b7-a1be-b8282556bb39 with Priority: HIGHEST for action port [ 986.918531] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.918531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.918531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.918531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.918531] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.919243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.919352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.921160] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2a8c269-bb5f-47b7-a1be-b8282556bb39 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.921160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2a8c269-bb5f-47b7-a1be-b8282556bb39" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.921160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2a8c269-bb5f-47b7-a1be-b8282556bb39" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.921160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2a8c269-bb5f-47b7-a1be-b8282556bb39" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.921160] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2a8c269-bb5f-47b7-a1be-b8282556bb39',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.422239] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.422871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.422871] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2a8c269-bb5f-47b7-a1be-b8282556bb39 with status ACTIVE [ 987.422871] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.422871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.423142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.423142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.423240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.423413] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.423556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.423556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.423716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.423798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.423976] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.424106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.424166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.424308] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.424387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.424572] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2a8c269-bb5f-47b7-a1be-b8282556bb39 is going to be updated. [ 987.448980] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.449149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.449607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.449859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.450036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.450210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2a8c269-bb5f-47b7-a1be-b8282556bb39" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.723692] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 987.724031] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 987.724108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.724331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.724575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.724795] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.724940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.725037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.725269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.725392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.725505] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.227984] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.434760] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 988.434760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.434760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.435134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.435284] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.435338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.435459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.435840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.435840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.435840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.435840] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.732116] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.939066] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.235539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.235904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.235904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.236080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.236201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.236312] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 989.276277] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.277136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.277136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.278083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.278277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.289304] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 989.440332] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4755538-f7a6-45f7-9a19-37103260244a: rpc.has_security_group_logging(os_id): False [ 989.461028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.461378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.461378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.461502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.461552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.461780] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.461904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.461957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.462094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.462163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.462252] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 989.533136] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.533346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.533346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.533556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.533707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.549396] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 990.011679] env[65106]: INFO networking_nsxv3.common.synchronization [req-cd7a0121-ae0b-4dee-90a8-b5b74a2419ad req-7d59f20b-106a-4a80-acda-0017f80780e3 tempest-FloatingIPsAssociationTestJSON-1367400107 tempest-FloatingIPsAssociationTestJSON-1367400107-project-member] Enqueued Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 990.012043] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 with Priority: HIGHEST for action security_group_members [ 990.013785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a791c8c3-0f7e-4205-8d3d-977dc22a4708 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.013785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.013785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.013785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.013785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.013785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.013785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.013785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.013785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.013785] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a791c8c3-0f7e-4205-8d3d-977dc22a4708',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.517729] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.518069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.518069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.518240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.518331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.518563] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.518667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.518732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.518885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.518969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.519069] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 is going to be updated. [ 990.580984] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.581278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.581371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.582741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.582741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.598952] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: IN_PROGRESS for 2s [ 991.308889] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 991.309198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.309394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.309673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.309817] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.309943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.310029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.310161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.310290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.310352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.310399] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.564140] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 991.564499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.813943] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.814120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.814198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.814422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.814779] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.814779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.814779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.814934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.815033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.815118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.815369] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.815510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.815617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.815792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.815937] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.816044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.816155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.816324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.816404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.816512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.816638] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.002047] env[65106]: INFO networking_nsxv3.common.synchronization [req-6b12defa-d237-4eb1-934b-c894302ebb4e req-0ee5f0e0-e17d-40e4-9ebe-59efeda5d090 tempest-ServersWithSpecificFlavorTestJSON-165470677 tempest-ServersWithSpecificFlavorTestJSON-165470677-project-member] Enqueued Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 992.002866] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 with Priority: HIGHEST for action security_group_members [ 992.003072] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4202ae94-9151-4db6-b1be-f69fcc7dc349 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.003265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.003368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.003660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.003944] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.004198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.004311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.004598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.004721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.004942] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4202ae94-9151-4db6-b1be-f69fcc7dc349',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.320110] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cf4d8d-838b-4bef-8391-fb65a3ba9c75: rpc.has_security_group_logging(os_id): False [ 992.356579] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.356806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.356806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.357038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.357158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.357357] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.357464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.357520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.357641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.357716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.357893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.357994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.358170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.358330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.358413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.358591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.358697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.358752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.358862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.358929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.359089] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 992.435927] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.436097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.436168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.436383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.436583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.469022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 992.507668] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.507848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.507936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.508213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.554860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.555124] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.555245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.555336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.555541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.555615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.555705] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 is going to be updated. [ 992.614798] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 in Status: SUCCESS [ 992.615363] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a791c8c3-0f7e-4205-8d3d-977dc22a4708 deletion is rescheduled due to dependency. [ 992.615363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a791c8c3-0f7e-4205-8d3d-977dc22a4708" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.626845] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.627014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.627100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.627294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.627438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.638377] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: IN_PROGRESS for 2s [ 993.939105] env[65106]: INFO networking_nsxv3.common.synchronization [None req-c2cd855f-f9ab-4f11-b412-6a0a093b308e None None] Enqueued Resource ID: a9881087-4f5f-4daa-9885-15bb9220d655 with Priority: HIGHEST for action port [ 993.939665] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9881087-4f5f-4daa-9885-15bb9220d655 with Priority: HIGHEST for action port [ 993.939930] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9881087-4f5f-4daa-9885-15bb9220d655 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.940304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9881087-4f5f-4daa-9885-15bb9220d655" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.940457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9881087-4f5f-4daa-9885-15bb9220d655" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.940667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9881087-4f5f-4daa-9885-15bb9220d655" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.940763] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9881087-4f5f-4daa-9885-15bb9220d655',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.960433] env[65106]: INFO networking_nsxv3.common.synchronization [req-3b45746d-3bca-4a8c-ba56-bc857387516e req-c7a04fd0-d62f-4513-8f66-f3e3c057bb81 tempest-ListServerFiltersTestJSON-55285812 tempest-ListServerFiltersTestJSON-55285812-project-member] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 993.961168] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 993.961535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.961614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.961697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.961904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.962550] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.962550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.962550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.962550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.962749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.962749] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.220789] env[65106]: INFO networking_nsxv3.common.synchronization [None req-c6371394-f6f4-44b4-988c-516a991be6ba tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: a65a19b7-ffd3-4246-804c-c8d8d1ce3194 with Priority: HIGHEST for action security_group_rules [ 994.221369] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65a19b7-ffd3-4246-804c-c8d8d1ce3194 with Priority: HIGHEST for action security_group_rules [ 994.221746] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.222403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.222755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.223346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.223346] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a65a19b7-ffd3-4246-804c-c8d8d1ce3194',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.276570] env[65106]: INFO networking_nsxv3.common.synchronization [None req-cafef4d0-d3c5-4f89-95f6-15c533de0b66 tempest-ServerActionsV293TestJSON-556854681 tempest-ServerActionsV293TestJSON-556854681-project-member] Enqueued Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_rules [ 994.276976] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_rules [ 994.277883] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.277883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.277883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.277883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.278111] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.320960] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b23fafee-e9e0-4581-9f6d-2596d270d68d tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: a65a19b7-ffd3-4246-804c-c8d8d1ce3194 with Priority: HIGHEST for action security_group_rules [ 994.321625] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a65a19b7-ffd3-4246-804c-c8d8d1ce3194 with Priority: HIGHEST for action security_group_rules [ 994.322016] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.322768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.375332] env[65106]: INFO networking_nsxv3.common.synchronization [None req-1ed4c41d-04ac-4843-8392-c57fd3c6bb69 tempest-ServerActionsV293TestJSON-556854681 tempest-ServerActionsV293TestJSON-556854681-project-member] Enqueued Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_rules [ 994.375332] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_rules [ 994.376406] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.377149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.445109] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9881087-4f5f-4daa-9885-15bb9220d655 [ 994.445484] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.445792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.446345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.446729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.446959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.447208] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9881087-4f5f-4daa-9885-15bb9220d655 already deleted. [ 994.447387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9881087-4f5f-4daa-9885-15bb9220d655" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.468155] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.482799] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 994.482799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.650649] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 in Status: SUCCESS [ 994.650892] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4202ae94-9151-4db6-b1be-f69fcc7dc349 deletion is rescheduled due to dependency. [ 994.650979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4202ae94-9151-4db6-b1be-f69fcc7dc349" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.747369] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.747569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.747569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.747775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.748131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.748131] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a65a19b7-ffd3-4246-804c-c8d8d1ce3194 already deleted. [ 994.748131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.748283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.748396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.748505] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a65a19b7-ffd3-4246-804c-c8d8d1ce3194',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.802079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.802244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.802323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.802700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.802800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.802906] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada already deleted. [ 994.802992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.803157] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.803333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.803425] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.969688] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.285267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.285611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.285771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.286154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.286332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.287115] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a65a19b7-ffd3-4246-804c-c8d8d1ce3194 already deleted. [ 995.287250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a65a19b7-ffd3-4246-804c-c8d8d1ce3194" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.326230] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.326230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.326230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.326230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.326230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.326230] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada already deleted. [ 995.326230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.476030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.476030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.476030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.476030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.476030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.476030] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 995.532327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.532556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.532635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.533834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.533834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.550379] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 996.392465] env[65106]: INFO networking_nsxv3.common.synchronization [req-15d78909-4492-4e4f-ba96-0412dfa98f8e req-464be9f6-2147-4bd8-93c3-2aaf8644a8b0 tempest-ServerAddressesTestJSON-1252412477 tempest-ServerAddressesTestJSON-1252412477-project-member] Enqueued Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGHEST for action security_group_members [ 996.394215] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGHEST for action security_group_members [ 996.394215] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-62831fc1-0f63-46d2-8f56-be3b23774df4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.394215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.394215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.394215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.394215] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.394215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.394761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.394761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.394761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.394761] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.779062] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-123 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.779062] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-123" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.779062] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-123" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.779062] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-123" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.779062] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.779062] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.779062] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.779596] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.779596] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.779596] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.779596] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.779796] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.779796] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.779897] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.779951] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.780075] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.805989] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.806270] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.806402] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.806630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-123" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.807081] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-b7345997-834c-4829-a1d4-e759f171db3e taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.807310] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-b7345997-834c-4829-a1d4-e759f171db3e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.807471] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-b7345997-834c-4829-a1d4-e759f171db3e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.807887] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-b7345997-834c-4829-a1d4-e759f171db3e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.808178] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7345997-834c-4829-a1d4-e759f171db3e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.897587] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.897816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.897816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.898044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.898136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.898352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.898445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.898508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.898662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.898734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.898818] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 already deleted. [ 996.898888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.311435] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.311682] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.311794] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.312081] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.312306] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.312558] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port b7345997-834c-4829-a1d4-e759f171db3e not found, creating... [ 997.312875] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.313056] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.313174] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.313418] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.313562] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.313905] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.314085] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.314234] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.314436] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.314627] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.314774] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: b7345997-834c-4829-a1d4-e759f171db3e is going to be created. [ 997.346699] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.347056] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.347236] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.347715] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.348278] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.348700] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-b7345997-834c-4829-a1d4-e759f171db3e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.565207] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 997.565542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.665661] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ad98c8c0-96e3-4648-8b80-7dd6f269f1cb None None] Enqueued Resource ID: 758dd358-b0a4-415b-b55f-39f9f536bd9d with Priority: HIGHEST for action port [ 997.666337] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 758dd358-b0a4-415b-b55f-39f9f536bd9d with Priority: HIGHEST for action port [ 997.666684] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-758dd358-b0a4-415b-b55f-39f9f536bd9d taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.667069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-758dd358-b0a4-415b-b55f-39f9f536bd9d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.667069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-758dd358-b0a4-415b-b55f-39f9f536bd9d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.667948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-758dd358-b0a4-415b-b55f-39f9f536bd9d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.668059] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('758dd358-b0a4-415b-b55f-39f9f536bd9d',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.777142] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f4598e0-2691-433c-adda-e5c89beb39d7 req-158ac681-45af-4ef0-900c-1eb1d1fbdc64 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 with Priority: HIGHEST for action security_group_members [ 997.777142] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f4598e0-2691-433c-adda-e5c89beb39d7 req-158ac681-45af-4ef0-900c-1eb1d1fbdc64 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 997.777665] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 with Priority: HIGHEST for action security_group_members [ 997.778134] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 997.778134] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0799e11e-8dbf-4164-84c4-683f58bedc85 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.778398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.778398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.778624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.778869] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.779212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.779339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.779457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.779688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.779688] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.780771] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.781066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.781066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.781245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.781587] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.781757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.781903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.782139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.782275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.782463] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.840400] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f4598e0-2691-433c-adda-e5c89beb39d7 req-158ac681-45af-4ef0-900c-1eb1d1fbdc64 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 with Priority: HIGHEST for action security_group_rules [ 997.840585] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f4598e0-2691-433c-adda-e5c89beb39d7 req-158ac681-45af-4ef0-900c-1eb1d1fbdc64 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 with Priority: HIGHEST for action security_group_members [ 997.840723] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f4598e0-2691-433c-adda-e5c89beb39d7 req-158ac681-45af-4ef0-900c-1eb1d1fbdc64 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_rules [ 997.840846] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f4598e0-2691-433c-adda-e5c89beb39d7 req-158ac681-45af-4ef0-900c-1eb1d1fbdc64 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 997.840973] env[65106]: INFO networking_nsxv3.common.synchronization [req-6f4598e0-2691-433c-adda-e5c89beb39d7 req-158ac681-45af-4ef0-900c-1eb1d1fbdc64 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with Priority: HIGHEST for action port [ 997.841845] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 with Priority: HIGHEST for action security_group_rules [ 997.841845] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_rules [ 997.843317] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with Priority: HIGHEST for action port [ 997.843317] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 with Priority: HIGHEST for action security_group_members [ 997.843317] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 997.843317] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0799e11e-8dbf-4164-84c4-683f58bedc85 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.843317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.843317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.843317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.843317] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.844179] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.844179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.844179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.844409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.844409] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.846649] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-940a255c-c8f1-43d2-ae1f-5bbfa4875527 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.846649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.846649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.846649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.846649] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940a255c-c8f1-43d2-ae1f-5bbfa4875527',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.846922] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0799e11e-8dbf-4164-84c4-683f58bedc85 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.847180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.847352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.847438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.141274] env[65106]: INFO networking_nsxv3.common.synchronization [req-15d78909-4492-4e4f-ba96-0412dfa98f8e req-ceaf005f-724c-4374-9f37-abfe808e5fea service nova] Enqueued Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGHEST for action security_group_rules [ 998.141510] env[65106]: INFO networking_nsxv3.common.synchronization [req-15d78909-4492-4e4f-ba96-0412dfa98f8e req-ceaf005f-724c-4374-9f37-abfe808e5fea service nova] Enqueued Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGHEST for action security_group_members [ 998.141633] env[65106]: INFO networking_nsxv3.common.synchronization [req-15d78909-4492-4e4f-ba96-0412dfa98f8e req-ceaf005f-724c-4374-9f37-abfe808e5fea service nova] Enqueued Resource ID: b7345997-834c-4829-a1d4-e759f171db3e with Priority: HIGHEST for action port [ 998.142362] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGHEST for action security_group_rules [ 998.142695] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGHEST for action security_group_members [ 998.142762] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7345997-834c-4829-a1d4-e759f171db3e with Priority: HIGHEST for action port [ 998.143132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62831fc1-0f63-46d2-8f56-be3b23774df4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.143400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.143496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.143778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.143958] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.146561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-62831fc1-0f63-46d2-8f56-be3b23774df4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.146725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.148766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.148766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.148766] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.148766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.149381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.154853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.154853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.154853] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.154853] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7345997-834c-4829-a1d4-e759f171db3e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.154853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7345997-834c-4829-a1d4-e759f171db3e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.154853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7345997-834c-4829-a1d4-e759f171db3e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.154853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7345997-834c-4829-a1d4-e759f171db3e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.154853] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7345997-834c-4829-a1d4-e759f171db3e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.170923] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 758dd358-b0a4-415b-b55f-39f9f536bd9d [ 998.171650] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.171650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.171650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.171926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.171926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.171926] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:758dd358-b0a4-415b-b55f-39f9f536bd9d already deleted. [ 998.172090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-758dd358-b0a4-415b-b55f-39f9f536bd9d" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.286536] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.286536] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.323881] env[65106]: INFO networking_nsxv3.common.synchronization [req-7de3c4ed-ca45-4b7e-8e1a-3287a0abcb8c req-1bc15c21-0ccb-45c7-98b7-96a548f9b693 tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 998.324733] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 998.325706] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.329647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.329647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.329647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.329647] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.329647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.329647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.329647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.329647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.329647] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.348781] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0799e11e-8dbf-4164-84c4-683f58bedc85 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.348781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.349349] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.351039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.351039] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with status ACTIVE [ 998.351039] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.351039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.351039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.351039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.351039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.351463] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.351463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.351463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.351577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.351649] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.351862] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.351960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.352064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.352264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.352352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.352565] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 is going to be updated. [ 998.390641] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.391018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.391146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.393158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.393274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.393472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.621106] env[65106]: INFO networking_nsxv3.common.synchronization [req-43d46014-611d-43c9-8b40-fe41acd11641 req-1cb09f4e-7a17-4bca-a69a-470edd18a5a4 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 with Priority: HIGHEST for action security_group_members [ 998.621106] env[65106]: INFO networking_nsxv3.common.synchronization [req-43d46014-611d-43c9-8b40-fe41acd11641 req-1cb09f4e-7a17-4bca-a69a-470edd18a5a4 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 998.621106] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 with Priority: HIGHEST for action security_group_members [ 998.621845] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 998.623135] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-0799e11e-8dbf-4164-84c4-683f58bedc85 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.623651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.624600] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.624600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.654481] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-62831fc1-0f63-46d2-8f56-be3b23774df4 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.654481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.661865] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7345997-834c-4829-a1d4-e759f171db3e with status ACTIVE [ 998.661865] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.661865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.661865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.661865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.661865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.661865] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.661865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.661865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.661865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.662997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.663598] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.666807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.666807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.666807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.666807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.666807] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7345997-834c-4829-a1d4-e759f171db3e is going to be updated. [ 998.668678] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.687030] env[65106]: INFO networking_nsxv3.common.synchronization [req-43d46014-611d-43c9-8b40-fe41acd11641 req-1cb09f4e-7a17-4bca-a69a-470edd18a5a4 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_rules [ 998.687030] env[65106]: INFO networking_nsxv3.common.synchronization [req-43d46014-611d-43c9-8b40-fe41acd11641 req-1cb09f4e-7a17-4bca-a69a-470edd18a5a4 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 998.687030] env[65106]: INFO networking_nsxv3.common.synchronization [req-43d46014-611d-43c9-8b40-fe41acd11641 req-1cb09f4e-7a17-4bca-a69a-470edd18a5a4 tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with Priority: HIGHEST for action port [ 998.687030] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_rules [ 998.687030] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 998.687030] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with Priority: HIGHEST for action port [ 998.687030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.687030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.687030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.687030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.687030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-940a255c-c8f1-43d2-ae1f-5bbfa4875527 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.687030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.687030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.689108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.689272] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('940a255c-c8f1-43d2-ae1f-5bbfa4875527',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.726648] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.726898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.726978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.727225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.727470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.727672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7345997-834c-4829-a1d4-e759f171db3e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.791545] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.792530] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.833499] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.833709] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.833783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.834025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.834123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.834328] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.834427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.834545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.834785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.834838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.835183] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 998.952539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.952539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.952981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.953545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.953545] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.964906] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 999.173369] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.192938] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 940a255c-c8f1-43d2-ae1f-5bbfa4875527 with status ACTIVE [ 999.192938] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.192938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.192938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.192938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.192938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.193301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.193301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.193301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.193412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.193491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.193672] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.193798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.193858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.194454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.194454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.194454] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 940a255c-c8f1-43d2-ae1f-5bbfa4875527 is going to be updated. [ 999.225049] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.225049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.225049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.225049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.225049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.225049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-940a255c-c8f1-43d2-ae1f-5bbfa4875527" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.296282] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.296282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.296282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.296282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.296282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.296282] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 is going to be created. [ 999.297332] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.297461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.297534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.297729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.297815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.297907] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be updated. [ 999.383687] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.383898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.383898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.384155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.384313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.397392] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.400086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.400263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.400488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.400657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.417939] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 in Status: UNINITIALIZED for 2s [ 999.422892] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: IN_PROGRESS for 2s [ 999.675179] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.675482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.675482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.675840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.676805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.677489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 is going to be created. [ 999.702297] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.702458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.702629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.702836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.703053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.715530] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 in Status: UNINITIALIZED for 2s [ 1000.977172] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1000.977900] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 1000.978816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.428415] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 in Status: SUCCESS [ 1001.428678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.428842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.429045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.429246] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.429364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.429430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.429590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.429668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.429786] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.431650] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: SUCCESS [ 1001.431879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.432016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.432315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.432396] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.432515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.432599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.432724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.432803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.432894] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.726408] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 in Status: SUCCESS [ 1001.726663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.726850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.727279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.727500] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.727652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.727724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.727895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.727986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.728106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.728193] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.935619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.935891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.935891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.936106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.936212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.937214] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.937214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.937214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.937214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.937214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.937214] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 is going to be deleted. [ 1001.939362] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.998347] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.998814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.998814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.998814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.999151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.999151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.999151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.999376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.999483] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.999582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.999632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.999853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.999947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.000031] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.075628] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b33c3b6f-aa15-4a21-ba21-e72682f6f7bb tempest-AttachVolumeTestJSON-98661006 tempest-AttachVolumeTestJSON-98661006-project-member] Enqueued Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_rules [ 1002.076308] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_rules [ 1002.076628] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.076755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.076821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.077255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.077372] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.231930] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-62831fc1-0f63-46d2-8f56-be3b23774df4 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.232151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.232222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.232730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.232730] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.233016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.233016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.233096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.233195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.233264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.233443] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-62831fc1-0f63-46d2-8f56-be3b23774df4 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.233555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.233624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.233838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.234075] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.234187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.234270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.234432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.234526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.234700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.234819] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.256488] env[65106]: INFO networking_nsxv3.common.synchronization [None req-aa56e8ef-9b55-44f8-8ea1-fbed8978f213 tempest-AttachVolumeTestJSON-98661006 tempest-AttachVolumeTestJSON-98661006-project-member] Enqueued Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_rules [ 1002.256834] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_rules [ 1002.257207] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.257317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.441917] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.502785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.502785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.502785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.502785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.502785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.503126] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.503126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.503126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.503281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.503281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.503362] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 already deleted. [ 1002.503438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.504321] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.509596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.509827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.510028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.510150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.510795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.510795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.510795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.510795] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.598980] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.599205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.599205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.599402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.599485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.599595] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 already deleted. [ 1002.599690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.599846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.599999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.600094] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.736950] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62831fc1-0f63-46d2-8f56-be3b23774df4: rpc.has_security_group_logging(os_id): False [ 1002.758561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.758895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.758895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.759053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.759105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.759293] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.759406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.759460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.759589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.759664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.759848] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.759940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.759993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.760151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.760221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.760399] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.760490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.760541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.760669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.760741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.760822] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 is going to be created. [ 1002.824847] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.824847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.824847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.824847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.824847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.836378] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 in Status: IN_PROGRESS for 2s [ 1002.944927] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.945117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.945223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.945771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.945914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.946045] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be updated. [ 1003.013560] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.013560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.013560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.013560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.013560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.014229] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0799e11e-8dbf-4164-84c4-683f58bedc85',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.020478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.020478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.020478] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 already deleted. [ 1003.020478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.031521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: IN_PROGRESS for 2s [ 1003.123405] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.123589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.123632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.123860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.123960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.124083] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 already deleted. [ 1003.124211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.333611] env[65106]: INFO networking_nsxv3.common.synchronization [req-a1851ccd-c539-4f6b-a4cd-635ad27ce474 req-3fa9b9a5-1fd6-45a2-9828-030983492e1a tempest-ServersNegativeTestJSON-2085709392 tempest-ServersNegativeTestJSON-2085709392-project-member] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1003.334379] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1003.334875] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.335015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.335524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.337014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.337014] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.337014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.337014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.337014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.337014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.337014] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.519150] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0799e11e-8dbf-4164-84c4-683f58bedc85: rpc.has_security_group_logging(os_id): False [ 1003.545622] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.545834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.545875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.546432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.546432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.546601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.546601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.546687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.547316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.547316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.547316] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 is going to be created. [ 1003.569838] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0799e11e-8dbf-4164-84c4-683f58bedc85], does not exist path=[/infra/domains/default/groups/0799e11e-8dbf-4164-84c4-683f58bedc85]."\n}' [ 1003.570265] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0799e11e-8dbf-4164-84c4-683f58bedc85 [ 1003.570417] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1003.622246] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.622458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.622458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.622689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.624926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.625385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.625555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.625668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.625904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.626050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.626681] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.627065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.627177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.627358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.627470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.627615] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0799e11e-8dbf-4164-84c4-683f58bedc85 is going to be created. [ 1003.649755] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/0799e11e-8dbf-4164-84c4-683f58bedc85], does not exist path=[/infra/domains/default/groups/0799e11e-8dbf-4164-84c4-683f58bedc85]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0799e11e-8dbf-4164-84c4-683f58bedc85 [ 1003.650609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0799e11e-8dbf-4164-84c4-683f58bedc85" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.650955] env[65106]: Traceback (most recent call last): [ 1003.651102] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1003.651102] env[65106]: return func(*args, **kwargs) [ 1003.651102] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1003.651102] env[65106]: res.raise_for_status() [ 1003.651102] env[65106]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1003.651102] env[65106]: raise HTTPError(http_error_msg, response=self) [ 1003.651102] env[65106]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0799e11e-8dbf-4164-84c4-683f58bedc85 [ 1003.651102] env[65106]: During handling of the above exception, another exception occurred: [ 1003.651102] env[65106]: Traceback (most recent call last): [ 1003.651102] env[65106]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1003.651102] env[65106]: listener.cb(fileno) [ 1003.651102] env[65106]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1003.651102] env[65106]: result = function(*args, **kwargs) [ 1003.651102] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 1003.651102] env[65106]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 1003.651102] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 1003.651102] env[65106]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 1003.651102] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 1003.651102] env[65106]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 1003.651102] env[65106]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 1003.651102] env[65106]: res.raise_for_status() [ 1003.651102] env[65106]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 1003.651102] env[65106]: raise HTTPError(http_error_msg, response=self) [ 1003.651102] env[65106]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/0799e11e-8dbf-4164-84c4-683f58bedc85 [ 1003.651102] env[65106]: Removing descriptor: 5 [ 1003.840451] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.030624] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.030917] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.030917] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.032230] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.032230] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.032230] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.032230] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.032230] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.032230] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.033285] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.033285] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1004.033285] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1004.033285] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1004.033285] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1004.033285] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1004.033285] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1004.070502] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1004.070694] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1004.070929] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1004.071039] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.071328] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.071520] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.071642] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.071982] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.072366] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.101154] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0b770749-3919-4466-906b-00d8079a8fcf None None] Enqueued Resource ID: 6b6132db-5ad3-44bb-8234-8cbd350c80a9 with Priority: HIGHEST for action port [ 1004.101154] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b6132db-5ad3-44bb-8234-8cbd350c80a9 with Priority: HIGHEST for action port [ 1004.101154] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b6132db-5ad3-44bb-8234-8cbd350c80a9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.101154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b6132db-5ad3-44bb-8234-8cbd350c80a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.101154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b6132db-5ad3-44bb-8234-8cbd350c80a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.101154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b6132db-5ad3-44bb-8234-8cbd350c80a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.101154] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b6132db-5ad3-44bb-8234-8cbd350c80a9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.345160] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.577427] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.577712] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.577894] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.578105] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.578279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.578447] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5 not found, creating... [ 1004.578916] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.578916] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.579095] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.579275] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.579426] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.579726] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.579898] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.580040] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.580496] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.580691] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.580853] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5 is going to be created. [ 1004.604218] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.604706] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.604706] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.605091] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.605298] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.605505] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.606476] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b6132db-5ad3-44bb-8234-8cbd350c80a9 [ 1004.607379] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.607379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.607379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.607379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.607379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.607379] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b6132db-5ad3-44bb-8234-8cbd350c80a9 already deleted. [ 1004.607379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b6132db-5ad3-44bb-8234-8cbd350c80a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.847234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.847376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.847814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.848041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.848180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.848239] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be updated. [ 1004.852989] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 in Status: SUCCESS [ 1004.853214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.891031] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.891201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.891248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.892672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.892672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.902036] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: IN_PROGRESS for 2s [ 1005.044785] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: SUCCESS [ 1005.045169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.045478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.045816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.045816] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.046333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.046432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.046669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.046915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.047066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.047223] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.049301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.049585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.049863] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.050060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.050186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.050683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.050683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.050683] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.374814] env[65106]: INFO networking_nsxv3.common.synchronization [req-a1851ccd-c539-4f6b-a4cd-635ad27ce474 req-9434099a-584e-4d19-9c5d-13265931b80e service nova] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_rules [ 1005.374814] env[65106]: INFO networking_nsxv3.common.synchronization [req-a1851ccd-c539-4f6b-a4cd-635ad27ce474 req-9434099a-584e-4d19-9c5d-13265931b80e service nova] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1005.374814] env[65106]: INFO networking_nsxv3.common.synchronization [req-a1851ccd-c539-4f6b-a4cd-635ad27ce474 req-9434099a-584e-4d19-9c5d-13265931b80e service nova] Enqueued Resource ID: f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5 with Priority: HIGHEST for action port [ 1005.374814] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_rules [ 1005.374814] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1005.374814] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5 with Priority: HIGHEST for action port [ 1005.375239] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.375699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.375781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.375991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.376089] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.377167] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.377270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.377511] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.377610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.377680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.377952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.378062] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.550141] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.550251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.553154] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.880093] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.880296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.880502] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5 with status ACTIVE [ 1005.880691] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.880807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.881053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.881127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.881200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.881792] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.881972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.882149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.882367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.882505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.884016] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.884016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.884016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.884016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.884016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.884016] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5 is going to be updated. [ 1005.915230] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.915376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.915448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.915728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.915890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.916188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f394bda9-8c5f-49cb-b0e7-2ca1a116cbf5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.059972] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.448230] env[65106]: INFO networking_nsxv3.common.synchronization [None req-b5670d13-9d2f-4789-9192-1ab9e71054d2 None None] Enqueued Resource ID: ca87127d-7c6d-408b-b0c1-0e7004fa08ed with Priority: HIGHEST for action port [ 1006.449384] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca87127d-7c6d-408b-b0c1-0e7004fa08ed with Priority: HIGHEST for action port [ 1006.451810] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca87127d-7c6d-408b-b0c1-0e7004fa08ed taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.451810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca87127d-7c6d-408b-b0c1-0e7004fa08ed" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.451810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca87127d-7c6d-408b-b0c1-0e7004fa08ed" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.451810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca87127d-7c6d-408b-b0c1-0e7004fa08ed" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.451810] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca87127d-7c6d-408b-b0c1-0e7004fa08ed',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.565945] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.567255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.567342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.567582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.567679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.568025] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be updated. [ 1006.617808] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.618022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.618067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.618281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.618436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.633605] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: IN_PROGRESS for 2s [ 1006.917350] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 1006.917583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.917782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.918222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.918222] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.918371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.918371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.918539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.918606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.918693] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.953560] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca87127d-7c6d-408b-b0c1-0e7004fa08ed [ 1006.953881] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.954054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.954153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.954435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.954561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.954843] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca87127d-7c6d-408b-b0c1-0e7004fa08ed already deleted. [ 1006.954958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca87127d-7c6d-408b-b0c1-0e7004fa08ed" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.420851] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.923588] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.345771] env[65106]: INFO networking_nsxv3.common.synchronization [req-a4e60dbf-4dcf-4550-9fce-c74eeeb227b6 req-89fd8cdc-e458-4655-aac7-ed37fc02016a tempest-ServerRescueTestJSONUnderV235-1424277025 tempest-ServerRescueTestJSONUnderV235-1424277025-project-member] Enqueued Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 1008.346896] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23fe2875-1973-4bdd-9d70-ecf412917573 with Priority: HIGHEST for action security_group_members [ 1008.349592] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.349592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.426639] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.427732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.429364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.429364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.429364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.429364] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be updated. [ 1008.469020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.469193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.469262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.469503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.470954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.482539] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: IN_PROGRESS for 2s [ 1008.646711] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: SUCCESS [ 1008.646711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.646711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.646711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.646867] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.646996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.647082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.647228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.647302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.647412] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.152653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.152653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.152653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.152995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.176109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.176359] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.176497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.176559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.176993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.177289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.177348] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be updated. [ 1009.211060] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.211259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.211518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.211818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.211975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.225076] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: IN_PROGRESS for 2s [ 1010.504646] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 1010.504646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.505061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.505061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.505666] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.505666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.505666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.505666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.506049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.506049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.506049] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.945725] env[65106]: INFO networking_nsxv3.common.synchronization [req-26dd0992-5a8d-40e6-829d-baf0da4380fa req-30483a43-6edf-4505-b88e-c752ba28b57c tempest-ServerAddressesTestJSON-1252412477 tempest-ServerAddressesTestJSON-1252412477-project-member] Enqueued Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGHEST for action security_group_members [ 1010.946681] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGHEST for action security_group_members [ 1010.947201] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-62831fc1-0f63-46d2-8f56-be3b23774df4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.947386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.947503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.947749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.947972] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.948180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.948303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.948526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.948651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.948809] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.009326] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.009606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.009721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.010083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.010352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.010530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.010634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.010910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.011050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.011214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.011455] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.011623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.011721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.011945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.012232] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.012381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.012482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.012741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.012897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.013028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.013181] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.242025] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: SUCCESS [ 1011.242025] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 deletion is rescheduled due to dependency. [ 1011.242025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.242025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.242025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.242025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.242025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.242025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.242025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.242025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.242516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.242516] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-23fe2875-1973-4bdd-9d70-ecf412917573 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.242516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.242516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.242516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.242690] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.242925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.242925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.245587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.245740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.245838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.245923] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.246900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.247150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.247336] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.248171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.248171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.248171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.248171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.248171] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.450589] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.451117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.451117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.452420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.496451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.497068] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.497313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.497446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.497745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.497958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.498157] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 is going to be updated. [ 1011.517728] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff: rpc.has_security_group_logging(os_id): False [ 1011.544156] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.544444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.544519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.546404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.546530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.549458] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.549458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.549458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.549458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.574127] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 in Status: IN_PROGRESS for 2s [ 1011.580153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.580538] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.580751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.580868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.581238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.581486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.581788] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.581954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.582094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.582334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.582476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.582792] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.583191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.583191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.583411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.583583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.583734] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be updated. [ 1011.661652] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.661863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.661927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.662164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.662318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.677011] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: IN_PROGRESS for 2s [ 1011.750582] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23fe2875-1973-4bdd-9d70-ecf412917573: rpc.has_security_group_logging(os_id): False [ 1011.751664] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.751792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.751853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.752072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.752161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.752350] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.752446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.752508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.752727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.752804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.752890] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be updated. [ 1011.783165] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.783369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.783369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.783565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.783652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.783876] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.783976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.784074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.784233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.784310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.784487] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.784581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.784717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.784893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.784971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.785169] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.785262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.785322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.785460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.785534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.785668] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be updated. [ 1011.817134] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.817393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.817393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.817563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.817710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.840145] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: IN_PROGRESS for 2s [ 1011.946442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.946597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.946669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.946975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.947158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.970905] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: IN_PROGRESS for 2s [ 1012.162717] env[65106]: INFO networking_nsxv3.common.synchronization [req-6c7927a3-5437-4ac1-865f-55840d0fc18e req-6a97da58-a148-4eaa-81c7-3dfdcf641d20 tempest-ListServerFiltersTestJSON-55285812 tempest-ListServerFiltersTestJSON-55285812-project-member] Enqueued Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 1012.162717] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4453797-05cb-4758-bad7-725b4ea09d52 with Priority: HIGHEST for action security_group_members [ 1012.162717] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4453797-05cb-4758-bad7-725b4ea09d52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.162717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.162932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.164026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.164026] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.164026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.164026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.164026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.164026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.164026] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4453797-05cb-4758-bad7-725b4ea09d52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.668145] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.668145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.668145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.668564] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.693417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.693827] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.694088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.694252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.694524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.694789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.694931] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 is going to be updated. [ 1012.741818] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.742467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.742467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.742467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.742467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.755283] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: IN_PROGRESS for 2s [ 1013.586974] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 in Status: SUCCESS [ 1013.590710] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 deletion is rescheduled due to dependency. [ 1013.590710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.692700] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 1013.693078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.854036] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: SUCCESS [ 1013.854036] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 deletion is rescheduled due to dependency. [ 1013.854036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.985569] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23fe2875-1973-4bdd-9d70-ecf412917573 in Status: SUCCESS [ 1013.985804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.985973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.986209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.986300] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23fe2875-1973-4bdd-9d70-ecf412917573',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.509964] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.510145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.510250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.510418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.510525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.510609] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23fe2875-1973-4bdd-9d70-ecf412917573 is going to be deleted. [ 1014.572089] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.572917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.572917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.572917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.572917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.572917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23fe2875-1973-4bdd-9d70-ecf412917573" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.765421] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4453797-05cb-4758-bad7-725b4ea09d52 in Status: SUCCESS [ 1014.765833] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4453797-05cb-4758-bad7-725b4ea09d52 deletion is rescheduled due to dependency. [ 1014.765833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4453797-05cb-4758-bad7-725b4ea09d52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.163605] env[65106]: INFO networking_nsxv3.common.synchronization [req-df0365e7-9719-4ddf-9088-068dfb2e76fd req-ca455650-f6ba-4156-b080-8a2eb3c29b5f tempest-ServersNegativeTestJSON-2085709392 tempest-ServersNegativeTestJSON-2085709392-project-member] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1016.164282] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1016.164690] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.164834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.164897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.165383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.166535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.166656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.166717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.167468] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.167468] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.167468] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.670354] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.174389] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.682577] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.682577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.682577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.682577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.682577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.682577] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be updated. [ 1017.717177] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.717177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.717177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.717177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.717177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.729390] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: IN_PROGRESS for 2s [ 1017.965703] env[65106]: INFO networking_nsxv3.common.synchronization [req-076482f6-9308-47d0-8bb4-ff35e627342a req-47c6e830-bd81-4d56-94c0-93d3bb0b826c tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1017.966812] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1017.966812] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.966812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.966812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.966998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.967250] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.967351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.967407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.967567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.967983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.967983] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.415287] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.415630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.415630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.416057] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.416236] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.416825] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.416825] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.416825] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.416983] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.417185] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.417302] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1018.417417] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1018.418033] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1018.418033] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1018.418033] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1018.418033] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1018.438990] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1018.439219] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1018.439362] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1018.439539] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.439858] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-3b53462d-5fa5-4dbb-88cb-f2f79041a808 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.440043] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-3b53462d-5fa5-4dbb-88cb-f2f79041a808" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.440161] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-3b53462d-5fa5-4dbb-88cb-f2f79041a808" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.440484] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-3b53462d-5fa5-4dbb-88cb-f2f79041a808" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.440621] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b53462d-5fa5-4dbb-88cb-f2f79041a808',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.471559] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.471756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.471823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.472054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.494264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.496394] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.496394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.496394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.496394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.496394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.496394] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1018.524156] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.524307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.524379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.524592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.524820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.537442] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1018.942918] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.943225] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.943317] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.943566] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.943718] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.943939] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 3b53462d-5fa5-4dbb-88cb-f2f79041a808 not found, creating... [ 1018.944145] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.944298] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.944411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.944619] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.944822] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.945124] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.945273] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.945388] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.945593] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.945750] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.945912] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 3b53462d-5fa5-4dbb-88cb-f2f79041a808 is going to be created. [ 1018.965745] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.965993] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.966432] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.966432] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.966636] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.966846] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-3b53462d-5fa5-4dbb-88cb-f2f79041a808" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.365783] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1019.365783] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent loop - iteration:2 started [ 1019.683666] env[65106]: INFO networking_nsxv3.common.synchronization [req-076482f6-9308-47d0-8bb4-ff35e627342a req-c76478e2-bdfe-4087-94e1-c25abb718ce8 service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 1019.683962] env[65106]: INFO networking_nsxv3.common.synchronization [req-076482f6-9308-47d0-8bb4-ff35e627342a req-c76478e2-bdfe-4087-94e1-c25abb718ce8 service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1019.683962] env[65106]: INFO networking_nsxv3.common.synchronization [req-076482f6-9308-47d0-8bb4-ff35e627342a req-c76478e2-bdfe-4087-94e1-c25abb718ce8 service nova] Enqueued Resource ID: 3b53462d-5fa5-4dbb-88cb-f2f79041a808 with Priority: HIGHEST for action port [ 1019.684459] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 1019.684591] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1019.685143] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b53462d-5fa5-4dbb-88cb-f2f79041a808 with Priority: HIGHEST for action port [ 1019.685456] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.685580] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.685655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.685854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.685958] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.686825] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.686925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.687140] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b53462d-5fa5-4dbb-88cb-f2f79041a808 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.687239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b53462d-5fa5-4dbb-88cb-f2f79041a808" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.687303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b53462d-5fa5-4dbb-88cb-f2f79041a808" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.687474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b53462d-5fa5-4dbb-88cb-f2f79041a808" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.687572] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b53462d-5fa5-4dbb-88cb-f2f79041a808',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.739389] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 1019.739618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.189952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.190696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.190696] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b53462d-5fa5-4dbb-88cb-f2f79041a808 with status ACTIVE [ 1020.190696] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.190696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.190696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.190969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.190969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.191124] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.191219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.191281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.191462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.191546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.191760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.195488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.195488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.195488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.195488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.195488] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b53462d-5fa5-4dbb-88cb-f2f79041a808 is going to be updated. [ 1020.232310] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.232507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.232553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.232847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.233062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.233306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b53462d-5fa5-4dbb-88cb-f2f79041a808" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.351167] env[65106]: INFO networking_nsxv3.common.synchronization [req-58f63556-a2ce-4bbf-ad2b-d7e5f740461b req-f1be112c-5f77-4819-bbfe-43414a079288 tempest-AttachVolumeTestJSON-98661006 tempest-AttachVolumeTestJSON-98661006-project-member] Enqueued Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_members [ 1020.352054] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_members [ 1020.352054] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.352223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.352223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.352568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.352772] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.352772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.353023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.353023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.353158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.353158] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.522508] env[65106]: INFO networking_nsxv3.common.synchronization [None req-7bc9121f-f2a6-413b-a03c-a1447a9adc3e None None] Enqueued Resource ID: dfc9ba2c-177c-48bc-aa4c-81540c619cb0 with Priority: HIGHEST for action port [ 1020.523261] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfc9ba2c-177c-48bc-aa4c-81540c619cb0 with Priority: HIGHEST for action port [ 1020.523619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfc9ba2c-177c-48bc-aa4c-81540c619cb0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.523619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfc9ba2c-177c-48bc-aa4c-81540c619cb0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.523619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfc9ba2c-177c-48bc-aa4c-81540c619cb0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.523804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfc9ba2c-177c-48bc-aa4c-81540c619cb0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.523908] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfc9ba2c-177c-48bc-aa4c-81540c619cb0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.547636] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1020.547778] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 1020.547900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.548235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.548235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.548404] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.548511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.548565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.548741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.548807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.548880] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.727262] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-978 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.727557] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-978" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.727557] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-978" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.727957] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-978" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.728054] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.728167] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.728280] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.728499] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.728757] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.728821] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.728965] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1020.731495] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1020.731495] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1020.731495] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1020.731495] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1020.731495] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1020.749243] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1020.749243] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1020.749243] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1020.749243] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-978" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.749243] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-b3350308-260c-4899-8c93-353745b00082 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.749529] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-b3350308-260c-4899-8c93-353745b00082" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.749529] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-b3350308-260c-4899-8c93-353745b00082" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.749787] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-b3350308-260c-4899-8c93-353745b00082" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.749921] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3350308-260c-4899-8c93-353745b00082',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.855866] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.856057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.856194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.856337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.856422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.856613] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.856711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.856768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.856912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.857040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.857094] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 already deleted. [ 1020.857199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.027122] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfc9ba2c-177c-48bc-aa4c-81540c619cb0 [ 1021.027354] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.027485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.027552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.027763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.027849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.027943] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfc9ba2c-177c-48bc-aa4c-81540c619cb0 already deleted. [ 1021.028031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfc9ba2c-177c-48bc-aa4c-81540c619cb0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.050413] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.252183] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.252433] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.252561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.252925] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.253091] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.253250] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port b3350308-260c-4899-8c93-353745b00082 not found, creating... [ 1021.253508] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.253665] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.253784] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.254093] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.254246] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.255035] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.255035] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.255035] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.255035] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.255250] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.255341] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: b3350308-260c-4899-8c93-353745b00082 is going to be created. [ 1021.277217] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.277313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.277384] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.278323] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.278323] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.278674] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-b3350308-260c-4899-8c93-353745b00082" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.553658] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.000643] env[65106]: INFO networking_nsxv3.common.synchronization [req-58f63556-a2ce-4bbf-ad2b-d7e5f740461b req-0a791f7a-099e-4e43-a0ab-74abd8fe7710 service nova] Enqueued Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_rules [ 1022.000643] env[65106]: INFO networking_nsxv3.common.synchronization [req-58f63556-a2ce-4bbf-ad2b-d7e5f740461b req-0a791f7a-099e-4e43-a0ab-74abd8fe7710 service nova] Enqueued Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_members [ 1022.000941] env[65106]: INFO networking_nsxv3.common.synchronization [req-58f63556-a2ce-4bbf-ad2b-d7e5f740461b req-0a791f7a-099e-4e43-a0ab-74abd8fe7710 service nova] Enqueued Resource ID: b3350308-260c-4899-8c93-353745b00082 with Priority: HIGHEST for action port [ 1022.001779] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_rules [ 1022.001779] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_members [ 1022.001779] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3350308-260c-4899-8c93-353745b00082 with Priority: HIGHEST for action port [ 1022.002107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.002178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.002225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.002447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.002578] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.003566] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.003566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.003670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.004138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.004138] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.004283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.004283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.005552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.005552] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.005552] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.008329] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3350308-260c-4899-8c93-353745b00082 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.008329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3350308-260c-4899-8c93-353745b00082" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.008329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3350308-260c-4899-8c93-353745b00082" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.008329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3350308-260c-4899-8c93-353745b00082" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.008329] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3350308-260c-4899-8c93-353745b00082',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.055896] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.056070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.056182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.056344] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.056442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.056536] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1022.087142] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.087142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.087142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.087142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.087142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.095436] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1022.509309] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.509459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.513297] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3350308-260c-4899-8c93-353745b00082 with status ACTIVE [ 1022.513852] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.513852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.513852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.515065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.515065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.515065] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.515065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.515065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.515065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.515065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.515065] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.515065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.515065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.515409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.515409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.515409] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3350308-260c-4899-8c93-353745b00082 is going to be updated. [ 1022.516444] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.538885] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.538885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.538885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.539113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.539212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.539432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3350308-260c-4899-8c93-353745b00082" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.674191] env[65106]: INFO networking_nsxv3.common.synchronization [req-a5b7d487-c569-4e33-a60f-3a06f697ba18 req-3f554471-7567-4ba3-a9f1-9783acb633ca tempest-ServerPasswordTestJSON-1909421353 tempest-ServerPasswordTestJSON-1909421353-project-member] Enqueued Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGHEST for action security_group_members [ 1022.674191] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGHEST for action security_group_members [ 1022.674314] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.674391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.674454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.674717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.674875] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.674970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.675408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.675843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.675843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.676267] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.994448] env[65106]: INFO networking_nsxv3.common.synchronization [None req-895101d0-6b28-4a94-b899-e867b9193a36 None None] Enqueued Resource ID: a15d233e-ea36-4bea-9e08-afc1df5605a2 with Priority: HIGHEST for action port [ 1022.995593] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a15d233e-ea36-4bea-9e08-afc1df5605a2 with Priority: HIGHEST for action port [ 1022.996179] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a15d233e-ea36-4bea-9e08-afc1df5605a2 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.996451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a15d233e-ea36-4bea-9e08-afc1df5605a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.996630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a15d233e-ea36-4bea-9e08-afc1df5605a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.997140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a15d233e-ea36-4bea-9e08-afc1df5605a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.997309] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a15d233e-ea36-4bea-9e08-afc1df5605a2',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.002792] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-445 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.003137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-445" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.003401] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-445" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.003910] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-445" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.004347] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.004638] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.004876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.005258] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.005489] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.005815] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.006027] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1023.006251] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1023.006449] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1023.006667] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1023.006891] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1023.007158] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1023.020046] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.052124] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1023.053797] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1023.053797] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1023.053797] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-445" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.053797] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.053797] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.053797] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.054401] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.054401] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c081f9a-57e0-4f08-b5a7-7946e6f219c6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.178654] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.178751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.179533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.179789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.179886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.180116] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.180358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.180358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.180483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.180520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.180580] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c already deleted. [ 1023.180653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.511866] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a15d233e-ea36-4bea-9e08-afc1df5605a2 [ 1023.512160] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.512346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.512464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.512775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.512907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.515026] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a15d233e-ea36-4bea-9e08-afc1df5605a2 already deleted. [ 1023.515026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a15d233e-ea36-4bea-9e08-afc1df5605a2" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.523080] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.524150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.524416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.525007] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.525007] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.525880] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 is going to be created. [ 1023.550234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.550234] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.550350] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.550660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.550905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.557649] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.557979] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.558271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.558565] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.558797] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.559040] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 2c081f9a-57e0-4f08-b5a7-7946e6f219c6 not found, creating... [ 1023.560197] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.560197] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.560197] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.560485] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.560885] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.561785] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.562052] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.562261] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.562632] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.564123] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.564123] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 2c081f9a-57e0-4f08-b5a7-7946e6f219c6 is going to be created. [ 1023.566126] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c074b17-b18d-425c-b595-ed5504aae380 in Status: UNINITIALIZED for 2s [ 1023.585663] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.585796] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.586513] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.586513] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.586513] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.586734] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.954973] env[65106]: INFO networking_nsxv3.common.synchronization [None req-51022668-23b3-4f9f-8410-b79511868e2c tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_rules [ 1023.955646] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_rules [ 1023.956059] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b922414d-be26-4348-b82b-5fd8d10033d4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.956220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.956320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.956598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.956715] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.037318] env[65106]: INFO networking_nsxv3.common.synchronization [None req-34c51163-fa47-43aa-9e92-172d47458106 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_rules [ 1024.038492] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_rules [ 1024.038492] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b922414d-be26-4348-b82b-5fd8d10033d4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.038492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.106628] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1024.106955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.107191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.107447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.107642] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.107801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.107872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.108618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.109585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.109585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.109585] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.363697] env[65106]: INFO networking_nsxv3.common.synchronization [req-a5b7d487-c569-4e33-a60f-3a06f697ba18 req-3f611398-8352-4580-b174-b13f191a4b1c service nova] Enqueued Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGHEST for action security_group_rules [ 1024.363877] env[65106]: INFO networking_nsxv3.common.synchronization [req-a5b7d487-c569-4e33-a60f-3a06f697ba18 req-3f611398-8352-4580-b174-b13f191a4b1c service nova] Enqueued Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGHEST for action security_group_members [ 1024.364059] env[65106]: INFO networking_nsxv3.common.synchronization [req-a5b7d487-c569-4e33-a60f-3a06f697ba18 req-3f611398-8352-4580-b174-b13f191a4b1c service nova] Enqueued Resource ID: 2c081f9a-57e0-4f08-b5a7-7946e6f219c6 with Priority: HIGHEST for action port [ 1024.364603] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGHEST for action security_group_rules [ 1024.364808] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGHEST for action security_group_members [ 1024.364888] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c081f9a-57e0-4f08-b5a7-7946e6f219c6 with Priority: HIGHEST for action port [ 1024.365190] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.365315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.365483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.365690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.365690] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.366702] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.366702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.366849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.367326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.367326] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.367326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.367482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.367630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.367777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.367941] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.369970] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.369970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.369970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.369970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.369970] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c081f9a-57e0-4f08-b5a7-7946e6f219c6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.478810] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.478981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.479038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.479249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.479337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.479433] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b922414d-be26-4348-b82b-5fd8d10033d4 already deleted. [ 1024.479515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.479663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.479815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.479901] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.615295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.615295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.615295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.615295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.615823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.615823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.615823] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.615823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.615823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.615977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.615977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.616293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.616293] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.871542] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.871721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.871924] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.875521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c081f9a-57e0-4f08-b5a7-7946e6f219c6 with status ACTIVE [ 1024.875673] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.875940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.876038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.876377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.876377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.876529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.876624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.876689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.876834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.876968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.877128] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.877217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.877278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.877419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.877488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.877567] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c081f9a-57e0-4f08-b5a7-7946e6f219c6 is going to be updated. [ 1024.899371] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.899583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.899583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.899794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.899927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.900093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c081f9a-57e0-4f08-b5a7-7946e6f219c6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.006061] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.006264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.006264] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.007041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.007041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.007041] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b922414d-be26-4348-b82b-5fd8d10033d4 already deleted. [ 1025.007041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.120381] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00fc8ecc-2b12-478d-8a50-43a7183605bc: rpc.has_security_group_logging(os_id): False [ 1025.139623] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.139800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.139852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.141489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.141489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.141489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.142050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.145050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.145050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.145050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.145050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.145050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.145050] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1025.220846] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.221154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.221154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.221334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.221539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.240573] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1025.374695] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.581019] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c074b17-b18d-425c-b595-ed5504aae380 in Status: SUCCESS [ 1025.581244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.581436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.581623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.581817] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.581937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.582011] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.582174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.582251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.582335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.582428] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.877105] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.877277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.877348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.877582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.877672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.877780] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c is going to be created. [ 1025.904942] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.905180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.905180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.905423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.905579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.917121] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c in Status: UNINITIALIZED for 2s [ 1026.087507] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.589438] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c074b17-b18d-425c-b595-ed5504aae380: rpc.has_security_group_logging(os_id): False [ 1026.608769] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.608769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.608769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.608769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.608769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.610078] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.610078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.610078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.610078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.610078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.610078] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 is going to be created. [ 1026.687195] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.687195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.687195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.687455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.687659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.714846] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c074b17-b18d-425c-b595-ed5504aae380 in Status: IN_PROGRESS for 2s [ 1027.258027] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1027.258220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.930340] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c in Status: SUCCESS [ 1027.930340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.930340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.930777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.930922] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.931059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.931124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.931302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.931408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.931501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.931644] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.314221] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.314221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.314221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.314221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.314221] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.436737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.436737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.436737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.436737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.436737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.437620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.437620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.437620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.437620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.437620] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.729695] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c074b17-b18d-425c-b595-ed5504aae380 in Status: SUCCESS [ 1028.731721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.820205] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.939864] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afb3113-d995-4d39-b176-5a19c6a11e2c: rpc.has_security_group_logging(os_id): False [ 1028.959565] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.959728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.959803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.960093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.960241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.960548] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.960605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.960682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.960960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.960960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.961211] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.961316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.962119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.962314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.962404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.962671] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.962800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.962874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.963038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.963116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.963207] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c is going to be created. [ 1029.028810] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.029164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.029164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.030064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.030064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.045094] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c in Status: IN_PROGRESS for 2s [ 1029.167673] env[65106]: INFO networking_nsxv3.common.synchronization [None req-a2996e99-6dc5-4b12-98e3-561a8b17681c None None] Enqueued Resource ID: f5a6efea-d7b0-4c63-8f04-1616c06e0a0f with Priority: HIGHEST for action port [ 1029.168303] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5a6efea-d7b0-4c63-8f04-1616c06e0a0f with Priority: HIGHEST for action port [ 1029.168616] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5a6efea-d7b0-4c63-8f04-1616c06e0a0f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.168745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5a6efea-d7b0-4c63-8f04-1616c06e0a0f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.168813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5a6efea-d7b0-4c63-8f04-1616c06e0a0f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.170422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5a6efea-d7b0-4c63-8f04-1616c06e0a0f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.170529] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5a6efea-d7b0-4c63-8f04-1616c06e0a0f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.321957] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.676579] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5a6efea-d7b0-4c63-8f04-1616c06e0a0f [ 1029.676579] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.676579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.676579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.676579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.676579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.676937] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5a6efea-d7b0-4c63-8f04-1616c06e0a0f already deleted. [ 1029.676937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5a6efea-d7b0-4c63-8f04-1616c06e0a0f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.825226] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1029.825446] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1030.703387] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.703387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.703387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.703387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.727060] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1030.728841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.730468] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1030.766893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.766893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.766893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.766893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.781211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.781211] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1030.781211] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1030.781211] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1030.825729] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.825962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.826077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.826272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.830500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.830854] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1030.918217] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.918217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.918217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.918217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.918217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.918217] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1030.997928] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.998179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.998179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.998378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.998624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.998951] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1030.999066] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'f5e826db-704a-4f90-8b10-2d48839251d7', '0c4b9f28-129e-4614-b2d6-9173d8122416', '89b2fdad-d445-45cc-854d-bad422551520', '4451dd0e-c25c-4af6-bb10-62fc99478e20', '4372f393-06e7-4930-9ab6-1687d050de71', 'aef9a0c3-8949-42e0-b152-6d0e475589ef', 'cb69e9e4-2eab-4e65-ad5f-9c7914f93491', '68b6b1dd-52ab-4ef3-8749-07f0a0035702', 'cbe5502d-c241-4f70-a5e4-91617fb44bf1', '9afb3113-d995-4d39-b176-5a19c6a11e2c', '108c3320-1bbb-4cb7-a30a-c66ddca2d037', '52a63c62-ab68-4afc-b239-81d4bb46173e', '63b6ebcd-ce8d-4da7-b33a-c7bd45edb898', '6d3d6dc0-48cf-4703-a02e-4166d71fd73a', 'f20d6572-0b4b-48a0-8c23-2a251368deef', 'a2cf4d8d-838b-4bef-8391-fb65a3ba9c75', '62831fc1-0f63-46d2-8f56-be3b23774df4', '9c074b17-b18d-425c-b595-ed5504aae380', '3d695ae0-3f98-46a7-8682-0daa0c8dbee9', '00fc8ecc-2b12-478d-8a50-43a7183605bc', '611ce8e9-468b-46ff-b93b-ebf52e6cce82', '80c55b4c-229d-4278-a249-6eb0843ce4fd', 'a791c8c3-0f7e-4205-8d3d-977dc22a4708', 'b4755538-f7a6-45f7-9a19-37103260244a', '5b77c3b5-bcbc-4373-ba6a-5877c470d364', '1c844632-55aa-48db-8ca5-f00fe2244035', 'ac9de4d4-ec9d-4ad4-ad6f-65eee9862501', '5e524fc2-f045-49dd-9b9d-694845e21af8', '7ea85039-86ee-4308-91e9-eb31b591a98a', 'b4453797-05cb-4758-bad7-725b4ea09d52', '8062a050-fddc-4392-b032-558be3ae0629', 'f58b21a0-a1cb-4daa-9136-8c66dc9641d3', 'bfd09ac0-101c-4f4a-a6a9-9a67108ff64a', '49f44a93-5686-4d9d-984b-4efb2550596c', 'faa319fa-2be7-45e6-acc2-0f5f031e93fb', 'f8e3138f-71fe-44de-b062-382436a9dc63', '0f36e318-4a87-4b4f-9bd9-1b549e42f93c', '339605f7-09cd-456f-a3a0-4495fb59f075', '2780c3aa-d7c0-4b04-ab51-f490d784ede7', '4dcae410-a891-453e-bd43-6b1770f373d3', 'c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9', 'ff5ba0af-d21f-4f03-b95d-0c41f57292b6', '01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff', '143c4b09-e4ef-4609-8ff0-863f1dce9402', '4202ae94-9151-4db6-b1be-f69fcc7dc349', '801f4d67-386f-4801-8f6a-7817c5da92ef'} {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1030.999177] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1031.022030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.022030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.022030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.022030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.022030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.024429] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1031.024429] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1031.024429] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1031.061131] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c in Status: SUCCESS [ 1031.061378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.110816] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.110952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.111032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.111241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.113832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.114408] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1031.114484] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1031.114550] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1031.114614] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1031.114688] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1031.114823] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGH for action security_group_rules [ 1031.114921] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGH for action security_group_rules [ 1031.114986] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGH for action security_group_rules [ 1031.115066] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGH for action security_group_rules [ 1031.115125] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGH for action security_group_rules [ 1031.115179] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGH for action security_group_rules [ 1031.115236] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGH for action security_group_rules [ 1031.115294] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGH for action security_group_rules [ 1031.115350] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGH for action security_group_rules [ 1031.115408] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGH for action security_group_rules [ 1031.115464] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGH for action security_group_rules [ 1031.115522] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGH for action security_group_rules [ 1031.115579] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGH for action security_group_rules [ 1031.115635] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGH for action security_group_rules [ 1031.115692] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGH for action security_group_rules [ 1031.115762] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGH for action security_group_rules [ 1031.115875] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGH for action security_group_rules [ 1031.115957] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGH for action security_group_rules [ 1031.116036] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGH for action security_group_rules [ 1031.116098] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGH for action security_group_rules [ 1031.116193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.541077] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d6fb6d68-cbad-4605-ae64-96f0b07061fe None None] Enqueued Resource ID: 7a36a7b5-4a22-4e89-9c5d-256df7b0ff52 with Priority: HIGHEST for action port [ 1031.541664] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a36a7b5-4a22-4e89-9c5d-256df7b0ff52 with Priority: HIGHEST for action port [ 1031.541920] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5e826db-704a-4f90-8b10-2d48839251d7 with Priority: HIGH for action security_group_rules [ 1031.541920] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89b2fdad-d445-45cc-854d-bad422551520 with Priority: HIGH for action security_group_rules [ 1031.542165] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 with Priority: HIGH for action security_group_rules [ 1031.542339] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGH for action security_group_rules [ 1031.542509] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGH for action security_group_rules [ 1031.542567] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 with Priority: HIGH for action security_group_rules [ 1031.542875] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGH for action security_group_rules [ 1031.542875] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 with Priority: HIGH for action security_group_rules [ 1031.542875] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a with Priority: HIGH for action security_group_rules [ 1031.543023] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGH for action security_group_rules [ 1031.543023] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGH for action security_group_rules [ 1031.543289] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52a63c62-ab68-4afc-b239-81d4bb46173e with Priority: HIGH for action security_group_rules [ 1031.543289] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 with Priority: HIGH for action security_group_rules [ 1031.543289] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGH for action security_group_rules [ 1031.543534] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 with Priority: HIGH for action security_group_rules [ 1031.543534] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGH for action security_group_rules [ 1031.543534] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGH for action security_group_rules [ 1031.543699] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGH for action security_group_rules [ 1031.543699] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 with Priority: HIGH for action security_group_rules [ 1031.543699] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGH for action security_group_rules [ 1031.544041] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a36a7b5-4a22-4e89-9c5d-256df7b0ff52 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.544218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a36a7b5-4a22-4e89-9c5d-256df7b0ff52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.544218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a36a7b5-4a22-4e89-9c5d-256df7b0ff52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.544477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a36a7b5-4a22-4e89-9c5d-256df7b0ff52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.544537] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a36a7b5-4a22-4e89-9c5d-256df7b0ff52',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.546030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f5e826db-704a-4f90-8b10-2d48839251d7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.546130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.546938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.546938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.546938] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f5e826db-704a-4f90-8b10-2d48839251d7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.547243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-89b2fdad-d445-45cc-854d-bad422551520 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.547337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.547395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.547544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.548790] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('89b2fdad-d445-45cc-854d-bad422551520',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.548790] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.550380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.550380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.550380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.550380] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb69e9e4-2eab-4e65-ad5f-9c7914f93491',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.550380] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.550380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.550380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.550380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.551211] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.551211] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.551460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.551600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.551673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.551743] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.552476] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.552630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.552630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.553304] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.553304] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d695ae0-3f98-46a7-8682-0daa0c8dbee9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.553830] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.554274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.554274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.554389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.554389] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.555115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62831fc1-0f63-46d2-8f56-be3b23774df4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.555697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.555697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.555697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.555697] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62831fc1-0f63-46d2-8f56-be3b23774df4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.556909] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.557046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.557117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.557297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.557337] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6d3d6dc0-48cf-4703-a02e-4166d71fd73a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.557982] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.558092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.558165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.558355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.558430] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.559604] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.559911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.559911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.560105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.560190] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.561078] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52a63c62-ab68-4afc-b239-81d4bb46173e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.561314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.561314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.562624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.562624] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52a63c62-ab68-4afc-b239-81d4bb46173e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.562624] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.562624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.562801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.562933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.562996] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('108c3320-1bbb-4cb7-a30a-c66ddca2d037',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.564502] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.564784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.564784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.564940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.565230] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.565684] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.565779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.565845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.565988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.566075] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbe5502d-c241-4f70-a5e4-91617fb44bf1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.567295] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.567397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.567455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.567596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.567669] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.568533] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.569348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.569348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.569348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.569348] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.569618] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.569691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.569750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.569894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.569964] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.570629] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4b9f28-129e-4614-b2d6-9173d8122416 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.570732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.570791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.570936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.571015] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4b9f28-129e-4614-b2d6-9173d8122416',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.571667] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.572260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.572312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.572434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.572508] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.078055] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.078349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.078349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.078635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.078712] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.078769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.078817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.078952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.079164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.079164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.079315] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.083231] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.083357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.083408] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.083582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.083734] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.083827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.083892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.084040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.084119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.084203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.084289] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.088674] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.088674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.088778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.088870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.089036] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.089141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.090846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.090846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.090846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.090846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.090846] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.090846] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.091169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.091169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.091251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.091875] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.091875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.091875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.091875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.091875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.091875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.092147] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.104462] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.104462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.104462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.104833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.104920] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.104968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.105035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.106637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.106637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.106637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.106637] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.106637] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.106637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.106637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.107284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.107284] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.107284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.107284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.107284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.107284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.107284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.107590] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.110454] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.110454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.110454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.110454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.110454] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.110454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.110454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.110454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.110454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.110454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.110454] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.114080] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a36a7b5-4a22-4e89-9c5d-256df7b0ff52 [ 1032.114275] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.114384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.114446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.114633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.114753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.114872] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a36a7b5-4a22-4e89-9c5d-256df7b0ff52 already deleted. [ 1032.114962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a36a7b5-4a22-4e89-9c5d-256df7b0ff52" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.115243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.115348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.115407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.116220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.116220] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.116220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.116220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.116542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.116542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.116542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.116646] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.119874] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.120099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.120678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.120986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.121311] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.121493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.121557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.121913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.121913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.122121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.122304] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.177531] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.177717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.177872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.178107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.181198] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.181198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.187937] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.188193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.197821] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.198260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.207868] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.207868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.209261] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.209397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.210417] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.210620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.211492] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.211592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.212911] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.212911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.214249] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.214249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.217557] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.217557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.220101] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1032.220792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.223020] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f5e826db-704a-4f90-8b10-2d48839251d7 is going to be deleted. [ 1032.223020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.223020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.234971] env[65106]: INFO networking_nsxv3.common.synchronization [req-2334d70f-23bd-4007-a824-c71723556364 req-9e0269a5-3634-400b-b9c2-30d6216ce184 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1032.236670] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1032.236670] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.236670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.236670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.237532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.237532] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.237532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.237532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.237936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.238117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.238389] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.252241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.252241] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52a63c62-ab68-4afc-b239-81d4bb46173e is going to be deleted. [ 1032.252241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.252488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.282431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.282431] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbe5502d-c241-4f70-a5e4-91617fb44bf1 is going to be deleted. [ 1032.283444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.285337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.307761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.307761] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62831fc1-0f63-46d2-8f56-be3b23774df4 is going to be deleted. [ 1032.309921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.309921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.313695] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.313940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.315934] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.316076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.331617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.331617] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb69e9e4-2eab-4e65-ad5f-9c7914f93491 is going to be deleted. [ 1032.332331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.332437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.381446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.381773] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d695ae0-3f98-46a7-8682-0daa0c8dbee9 is going to be deleted. [ 1032.384082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.384363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.444086] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.444086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.475833] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.475976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.498276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.498558] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6d3d6dc0-48cf-4703-a02e-4166d71fd73a is going to be deleted. [ 1032.504546] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.504732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.504732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.504983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.505092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.505226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbe5502d-c241-4f70-a5e4-91617fb44bf1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.505382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.505565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.589774] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.589939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.589997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.590385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.591062] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.591062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.591062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.591062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.591062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.591062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.591624] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.591624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.591624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.591624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.591624] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.591624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.591845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.591845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.591845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.591954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.592609] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.598112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.598112] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4b9f28-129e-4614-b2d6-9173d8122416 is going to be deleted. [ 1032.599386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.599571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.618801] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.630436] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.631604] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.632087] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.632257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.632331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.632546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.632832] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.632925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.632994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.633859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.633946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.634053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.634234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.634340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.634404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.635086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.635266] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.635405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.635471] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.635696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.635696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.635898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.635898] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.637880] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.637991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.638885] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.640974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.640974] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.640974] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.692068] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.692068] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 108c3320-1bbb-4cb7-a30a-c66ddca2d037 is going to be deleted. [ 1032.692910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.693178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.722795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.722795] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be deleted. [ 1032.724035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.724035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.724035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.724219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f5e826db-704a-4f90-8b10-2d48839251d7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.724255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.725523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.725523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.725523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52a63c62-ab68-4afc-b239-81d4bb46173e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.725523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.725523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.725523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.725523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62831fc1-0f63-46d2-8f56-be3b23774df4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.726101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.726101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.726192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.726279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb69e9e4-2eab-4e65-ad5f-9c7914f93491" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.726410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.726549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.743443] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.743583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.779139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.779364] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 89b2fdad-d445-45cc-854d-bad422551520 is going to be deleted. [ 1032.781083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.781367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.781501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.781659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d695ae0-3f98-46a7-8682-0daa0c8dbee9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.781875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.782130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.782210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.782352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6d3d6dc0-48cf-4703-a02e-4166d71fd73a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.782941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.783277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.783452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.783736] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.783958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.784693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.784693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.784693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.784693] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1032.819388] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.819626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.819724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.819955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.820064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.820227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4b9f28-129e-4614-b2d6-9173d8122416" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.821542] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.821662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.821730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.821910] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.822086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.829421] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.829942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.830075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.830294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.830449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.830784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-108c3320-1bbb-4cb7-a30a-c66ddca2d037" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.834485] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1032.843020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.843020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.843020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.843020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.843294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.843294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.869966] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.870191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.870300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.870571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.870673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.870862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-89b2fdad-d445-45cc-854d-bad422551520" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.100074] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f20d6572-0b4b-48a0-8c23-2a251368deef: rpc.has_security_group_logging(os_id): False [ 1033.113164] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.117658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.117658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.117748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.117885] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.117969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.118150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.118231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.118605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.118605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.118605] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.118605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.118803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.118803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.118979] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.119069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.119109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.119230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.119306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.119428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.119467] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.124965] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.124965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.124965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.124965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.124965] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aef9a0c3-8949-42e0-b152-6d0e475589ef: rpc.has_security_group_logging(os_id): False [ 1033.137662] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4372f393-06e7-4930-9ab6-1687d050de71: rpc.has_security_group_logging(os_id): False [ 1033.138785] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 68b6b1dd-52ab-4ef3-8749-07f0a0035702: rpc.has_security_group_logging(os_id): False [ 1033.143327] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c074b17-b18d-425c-b595-ed5504aae380: rpc.has_security_group_logging(os_id): False [ 1033.144381] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898: rpc.has_security_group_logging(os_id): False [ 1033.147357] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00fc8ecc-2b12-478d-8a50-43a7183605bc: rpc.has_security_group_logging(os_id): False [ 1033.148213] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.154893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.154893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.154893] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.154893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.155768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.155768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.155768] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be updated. [ 1033.155768] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.155768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.156064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.156064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.169150] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.169295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.174492] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.174603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.177684] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.178703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.178703] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.178844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.181783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.181783] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.181783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.181783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.181783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.181783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.181783] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef is going to be updated. [ 1033.183165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.183351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.185367] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.185629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.207437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.207754] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.207881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.207939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.208153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.209187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.209187] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 is going to be updated. [ 1033.209867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.209867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.229717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.230125] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.230270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.230270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.230449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.230483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.230707] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 is going to be updated. [ 1033.232383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.232383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.274353] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.274515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.280089] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.280520] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.280624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.280691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.280897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.280976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.281094] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 is going to be updated. [ 1033.284021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.284142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.287415] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.287415] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.330836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.331681] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.331681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.331681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.332326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.333033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.333249] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.333363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.333528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.333876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.333876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.335405] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.335405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.335405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.335405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.335405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.335405] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1033.338861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.341085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.341085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.341273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.341528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.353442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.353873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.387271] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: IN_PROGRESS for 2s [ 1033.408090] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.408197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.433369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.434280] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.434389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.434459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.434674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.434758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.434958] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 is going to be updated. [ 1033.440383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.443113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.443113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.443113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.443113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.443113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.446575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.446575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.446575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.465077] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c074b17-b18d-425c-b595-ed5504aae380 in Status: IN_PROGRESS for 2s [ 1033.465879] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aef9a0c3-8949-42e0-b152-6d0e475589ef in Status: IN_PROGRESS for 2s [ 1033.476046] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4372f393-06e7-4930-9ab6-1687d050de71 in Status: IN_PROGRESS for 2s [ 1033.479370] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.479734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.479734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.479833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.480038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.524658] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.524658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.524658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.524658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.524658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.527854] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 in Status: IN_PROGRESS for 2s [ 1033.567676] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1033.568882] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.568882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.568882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.569073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.569467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.588311] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: IN_PROGRESS for 2s [ 1033.627289] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9afb3113-d995-4d39-b176-5a19c6a11e2c: rpc.has_security_group_logging(os_id): False [ 1033.659483] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4451dd0e-c25c-4af6-bb10-62fc99478e20: rpc.has_security_group_logging(os_id): False [ 1033.674543] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.674734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.674828] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.676421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.687218] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.687218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.715481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.715750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.715880] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.715944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.716166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.716248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.716451] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.716550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.716614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.716759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.716843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.717039] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.717120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.717178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.717316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.717389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.717470] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c is going to be updated. [ 1033.719606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.719606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.746364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.746668] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.746788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.746857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.747135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.747247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.747337] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 is going to be updated. [ 1033.781298] env[65106]: INFO networking_nsxv3.common.synchronization [None req-16a6ed68-d3e5-4daa-9d57-d1882c799803 None None] Enqueued Resource ID: 71cbdede-ca0e-43c2-86d6-2348321d82ad with Priority: HIGHEST for action port [ 1033.781705] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71cbdede-ca0e-43c2-86d6-2348321d82ad with Priority: HIGHEST for action port [ 1033.782039] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-71cbdede-ca0e-43c2-86d6-2348321d82ad taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.782165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71cbdede-ca0e-43c2-86d6-2348321d82ad" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.782231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71cbdede-ca0e-43c2-86d6-2348321d82ad" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.782479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71cbdede-ca0e-43c2-86d6-2348321d82ad" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.782562] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71cbdede-ca0e-43c2-86d6-2348321d82ad',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.788891] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.788891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.788891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.788891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.788891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.802095] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.802246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.802309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.802547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.802706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.804975] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c in Status: IN_PROGRESS for 2s [ 1033.815559] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 in Status: IN_PROGRESS for 2s [ 1034.287301] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71cbdede-ca0e-43c2-86d6-2348321d82ad [ 1034.287301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.287301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.287301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.287301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.287301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.287301] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71cbdede-ca0e-43c2-86d6-2348321d82ad already deleted. [ 1034.287301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71cbdede-ca0e-43c2-86d6-2348321d82ad" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.622103] env[65106]: INFO networking_nsxv3.common.synchronization [None req-e51e2137-885d-48e8-852c-a6417a25caa5 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_rules [ 1034.623160] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_rules [ 1034.623160] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.624222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.624222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.624222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.624389] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.728359] env[65106]: INFO networking_nsxv3.common.synchronization [None req-6cffb458-670c-4592-b632-36bfecca2642 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_rules [ 1034.728968] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_rules [ 1034.729315] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.729418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.847228] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1034.847439] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 1034.847500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.916874] env[65106]: INFO networking_nsxv3.common.synchronization [None req-164244bd-c955-4db6-bf10-5239b630bf0e None None] Enqueued Resource ID: 57b49977-69fe-4414-9b62-187505f877d0 with Priority: HIGHEST for action port [ 1034.916874] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57b49977-69fe-4414-9b62-187505f877d0 with Priority: HIGHEST for action port [ 1034.916874] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-57b49977-69fe-4414-9b62-187505f877d0 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.916874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57b49977-69fe-4414-9b62-187505f877d0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.916874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57b49977-69fe-4414-9b62-187505f877d0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.916874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57b49977-69fe-4414-9b62-187505f877d0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.916874] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57b49977-69fe-4414-9b62-187505f877d0',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.145597] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.145746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.145746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.145899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.145988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.146091] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca already deleted. [ 1035.146173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.146322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.146503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.146621] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.400936] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: SUCCESS [ 1035.401346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.421789] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57b49977-69fe-4414-9b62-187505f877d0 [ 1035.422054] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.422256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.422333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.422546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.422637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.422721] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57b49977-69fe-4414-9b62-187505f877d0 already deleted. [ 1035.422808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57b49977-69fe-4414-9b62-187505f877d0" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.480621] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aef9a0c3-8949-42e0-b152-6d0e475589ef in Status: SUCCESS [ 1035.480855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.483726] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c074b17-b18d-425c-b595-ed5504aae380 in Status: SUCCESS [ 1035.483914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.490805] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4372f393-06e7-4930-9ab6-1687d050de71 in Status: SUCCESS [ 1035.491071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.547648] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 in Status: SUCCESS [ 1035.547648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.580768] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1035.581055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.603561] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: SUCCESS [ 1035.603780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.669047] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.669277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.669457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.669727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.669856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.670022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca already deleted. [ 1035.670163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.688913] env[65106]: INFO networking_nsxv3.common.synchronization [None req-4adcd056-7c2b-4633-840d-40443b1c6da6 None None] Enqueued Resource ID: 062bdb0a-7566-4bd9-b648-4b12e6ac4877 with Priority: HIGHEST for action port [ 1035.689963] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 062bdb0a-7566-4bd9-b648-4b12e6ac4877 with Priority: HIGHEST for action port [ 1035.694731] env[65106]: INFO networking_nsxv3.common.synchronization [req-8258b185-bc6d-4cc1-ace3-291eb2394ba6 req-b520c850-d342-4bae-a80a-107d5e57300b tempest-ServerActionsV293TestJSON-556854681 tempest-ServerActionsV293TestJSON-556854681-project-member] Enqueued Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_members [ 1035.696853] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-062bdb0a-7566-4bd9-b648-4b12e6ac4877 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.696853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-062bdb0a-7566-4bd9-b648-4b12e6ac4877" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.696853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-062bdb0a-7566-4bd9-b648-4b12e6ac4877" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.696853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-062bdb0a-7566-4bd9-b648-4b12e6ac4877" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.696853] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('062bdb0a-7566-4bd9-b648-4b12e6ac4877',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.700094] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_members [ 1035.703706] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.703706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.703706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.703706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.703706] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.703706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.703706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.703706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.703706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.703706] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.819116] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c in Status: SUCCESS [ 1035.819812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.829919] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 in Status: SUCCESS [ 1035.833462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.133083] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-24 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.133307] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-24" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.133767] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-24" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.133767] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-24" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.134196] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.134647] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.134779] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.135144] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.135357] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.135571] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.135684] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1036.135963] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1036.135963] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1036.136093] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1036.136166] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1036.136334] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1036.157974] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1036.158146] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1036.158291] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1036.158468] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-24" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.158796] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-485a6d6d-15b8-495b-99ca-0c847511231c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.158975] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-485a6d6d-15b8-495b-99ca-0c847511231c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.159112] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-485a6d6d-15b8-495b-99ca-0c847511231c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.159452] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-485a6d6d-15b8-495b-99ca-0c847511231c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.159589] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('485a6d6d-15b8-495b-99ca-0c847511231c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.199795] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 062bdb0a-7566-4bd9-b648-4b12e6ac4877 [ 1036.200279] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.200403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.200514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.200877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.200998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.202262] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:062bdb0a-7566-4bd9-b648-4b12e6ac4877 already deleted. [ 1036.202262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-062bdb0a-7566-4bd9-b648-4b12e6ac4877" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.206953] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.207126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.207176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.207396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.207488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.207697] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.208689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.208689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.208689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.208689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.208689] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada already deleted. [ 1036.208689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.613310] env[65106]: INFO networking_nsxv3.common.synchronization [req-dbf3ce69-4d2f-47b8-8ffb-164c37540f4b req-504d8582-38f4-498c-8b92-f9ac9eb659c7 tempest-ServerPasswordTestJSON-1909421353 tempest-ServerPasswordTestJSON-1909421353-project-member] Enqueued Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGHEST for action security_group_members [ 1036.614176] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGHEST for action security_group_members [ 1036.614289] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.614424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.614475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.614674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.614888] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.615106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.615106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.615479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.615589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.615691] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.663932] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.663932] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.663932] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.664244] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.664244] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.664317] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 485a6d6d-15b8-495b-99ca-0c847511231c not found, creating... [ 1036.664619] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.664856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.665093] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.665326] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.665464] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.665809] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.665966] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.666114] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.666709] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.666827] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.667089] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 485a6d6d-15b8-495b-99ca-0c847511231c is going to be created. [ 1036.688309] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.688522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.688640] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.688910] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.689158] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.689396] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-485a6d6d-15b8-495b-99ca-0c847511231c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.117939] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.118120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.118190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.118415] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.118507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.118701] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.118796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.118862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.119012] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.119088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.119174] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c is going to be updated. [ 1037.151019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.151019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.151019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.151019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.151019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.158377] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c in Status: IN_PROGRESS for 2s [ 1037.470478] env[65106]: INFO networking_nsxv3.common.synchronization [req-8258b185-bc6d-4cc1-ace3-291eb2394ba6 req-e7947f34-0c12-49a2-9c36-449c28117caa service nova] Enqueued Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_rules [ 1037.470819] env[65106]: INFO networking_nsxv3.common.synchronization [req-8258b185-bc6d-4cc1-ace3-291eb2394ba6 req-e7947f34-0c12-49a2-9c36-449c28117caa service nova] Enqueued Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_members [ 1037.471050] env[65106]: INFO networking_nsxv3.common.synchronization [req-8258b185-bc6d-4cc1-ace3-291eb2394ba6 req-e7947f34-0c12-49a2-9c36-449c28117caa service nova] Enqueued Resource ID: 485a6d6d-15b8-495b-99ca-0c847511231c with Priority: HIGHEST for action port [ 1037.471736] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_rules [ 1037.471736] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_members [ 1037.471974] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 485a6d6d-15b8-495b-99ca-0c847511231c with Priority: HIGHEST for action port [ 1037.472322] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.472455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.472537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.472796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.472796] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.474108] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.474328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.474398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.474575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.474730] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.474885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.474955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.475135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.475219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.475309] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.476225] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-485a6d6d-15b8-495b-99ca-0c847511231c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.476751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-485a6d6d-15b8-495b-99ca-0c847511231c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.476833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-485a6d6d-15b8-495b-99ca-0c847511231c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.476980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-485a6d6d-15b8-495b-99ca-0c847511231c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.477238] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('485a6d6d-15b8-495b-99ca-0c847511231c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.975210] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.975740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.981327] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.981327] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 485a6d6d-15b8-495b-99ca-0c847511231c with status ACTIVE [ 1037.981327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.981519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.981519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.981632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.984419] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.984419] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.984419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.984419] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 485a6d6d-15b8-495b-99ca-0c847511231c is going to be updated. [ 1038.027349] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.027498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.027569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.027815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.028375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.028567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-485a6d6d-15b8-495b-99ca-0c847511231c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.160730] env[65106]: INFO networking_nsxv3.common.synchronization [req-a0ecd925-d10a-43d0-b5cd-395bde73f26d req-42c3593d-5fac-45f3-ad5f-b0f62f29d383 tempest-ImagesOneServerTestJSON-2038695469 tempest-ImagesOneServerTestJSON-2038695469-project-member] Enqueued Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGHEST for action security_group_members [ 1038.161393] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGHEST for action security_group_members [ 1038.161722] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a5ed45f-6939-497b-9937-079be854fa2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.161858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.161899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.162534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.162601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.162990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.162990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.162990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.162990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.163157] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.485794] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.548553] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-556 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.548849] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-556" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.549027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-556" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.549669] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-556" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.549669] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.549874] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.550029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.550416] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.550416] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.550700] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.550842] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.550977] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.551121] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.551987] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.551987] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.551987] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.573128] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.573128] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.573128] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.573128] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-556" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.573128] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-043b85c7-0b49-42ab-8c5b-37190273da25 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.573128] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-043b85c7-0b49-42ab-8c5b-37190273da25" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.573404] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-043b85c7-0b49-42ab-8c5b-37190273da25" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.575021] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-043b85c7-0b49-42ab-8c5b-37190273da25" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.575021] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('043b85c7-0b49-42ab-8c5b-37190273da25',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.602560] env[65106]: INFO networking_nsxv3.common.synchronization [None req-2637cd78-ac37-492d-902a-7bee668aa040 None None] Enqueued Resource ID: 99208ac3-f6cc-4f47-a9e3-f3842984efab with Priority: HIGHEST for action port [ 1038.603751] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99208ac3-f6cc-4f47-a9e3-f3842984efab with Priority: HIGHEST for action port [ 1038.604207] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-99208ac3-f6cc-4f47-a9e3-f3842984efab taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.604500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99208ac3-f6cc-4f47-a9e3-f3842984efab" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.604500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99208ac3-f6cc-4f47-a9e3-f3842984efab" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.604813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99208ac3-f6cc-4f47-a9e3-f3842984efab" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.605032] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99208ac3-f6cc-4f47-a9e3-f3842984efab',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.666197] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.666570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.666570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.666886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.667073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.667374] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.667510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.667694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.667903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.668291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.668291] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a5ed45f-6939-497b-9937-079be854fa2e already deleted. [ 1038.668423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.989826] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.989826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.989826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.989826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.989826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.989826] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada is going to be created. [ 1039.016616] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.016800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.016846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.017131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.017303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.037270] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada in Status: UNINITIALIZED for 2s [ 1039.078623] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.078860] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.078990] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.079338] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.079586] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.079805] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 043b85c7-0b49-42ab-8c5b-37190273da25 not found, creating... [ 1039.080087] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.080255] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.080373] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.080604] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.080738] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.081034] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.081202] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.081436] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.081528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.081660] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.081799] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 043b85c7-0b49-42ab-8c5b-37190273da25 is going to be created. [ 1039.108073] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 99208ac3-f6cc-4f47-a9e3-f3842984efab [ 1039.108330] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.108484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.108555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.108738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.108823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.108918] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:99208ac3-f6cc-4f47-a9e3-f3842984efab already deleted. [ 1039.108999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99208ac3-f6cc-4f47-a9e3-f3842984efab" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.113358] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.113562] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.113683] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.113945] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.114196] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.114412] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-043b85c7-0b49-42ab-8c5b-37190273da25" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.170188] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c in Status: SUCCESS [ 1039.170472] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c deletion is rescheduled due to dependency. [ 1039.170753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.242027] env[65106]: INFO networking_nsxv3.common.synchronization [req-a0ecd925-d10a-43d0-b5cd-395bde73f26d req-85a18050-8500-4f00-8520-a8563d907a04 service nova] Enqueued Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGHEST for action security_group_rules [ 1040.242027] env[65106]: INFO networking_nsxv3.common.synchronization [req-a0ecd925-d10a-43d0-b5cd-395bde73f26d req-85a18050-8500-4f00-8520-a8563d907a04 service nova] Enqueued Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGHEST for action security_group_members [ 1040.242027] env[65106]: INFO networking_nsxv3.common.synchronization [req-a0ecd925-d10a-43d0-b5cd-395bde73f26d req-85a18050-8500-4f00-8520-a8563d907a04 service nova] Enqueued Resource ID: 043b85c7-0b49-42ab-8c5b-37190273da25 with Priority: HIGHEST for action port [ 1040.242027] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGHEST for action security_group_rules [ 1040.242027] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGHEST for action security_group_members [ 1040.242027] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 043b85c7-0b49-42ab-8c5b-37190273da25 with Priority: HIGHEST for action port [ 1040.248887] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a5ed45f-6939-497b-9937-079be854fa2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.248887] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.248887] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a5ed45f-6939-497b-9937-079be854fa2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.248887] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.248887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.248887] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.253311] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-043b85c7-0b49-42ab-8c5b-37190273da25 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.253311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-043b85c7-0b49-42ab-8c5b-37190273da25" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.253311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-043b85c7-0b49-42ab-8c5b-37190273da25" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.253311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-043b85c7-0b49-42ab-8c5b-37190273da25" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.253311] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('043b85c7-0b49-42ab-8c5b-37190273da25',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.694266] env[65106]: INFO networking_nsxv3.common.synchronization [req-13023ac4-ac4c-46c5-98ea-b2dcaa117acb req-7de33380-e840-4c6e-9a41-b5b1b0626ba6 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_members [ 1040.694266] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_members [ 1040.694266] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b922414d-be26-4348-b82b-5fd8d10033d4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.694266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.694266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.694903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.695040] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.695159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.695253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.695355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.695435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.695526] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.755440] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 043b85c7-0b49-42ab-8c5b-37190273da25 with status ACTIVE [ 1040.755661] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.755832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.755902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.756240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.756349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.756538] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.756640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.756713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.758358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.758358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.758500] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.758606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.758673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.758838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.758925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.759010] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 043b85c7-0b49-42ab-8c5b-37190273da25 is going to be updated. [ 1040.761590] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a5ed45f-6939-497b-9937-079be854fa2e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.761590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.761590] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.785715] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.785934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.785934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.787051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.787176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.788372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-043b85c7-0b49-42ab-8c5b-37190273da25" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.031079] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.031079] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.031079] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.031079] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.031079] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.031475] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.031475] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.031475] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.031611] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.031791] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.031895] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.032021] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.032126] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.032234] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.032350] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.032482] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.049293] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada in Status: SUCCESS [ 1041.049668] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.049950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.050268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.050569] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.050774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.050908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.051179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.051285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.051403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.051485] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.053671] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.054696] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.055740] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.056493] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.056816] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-ea86d517-cc16-44bb-908a-85abce556c82 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.056990] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-ea86d517-cc16-44bb-908a-85abce556c82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.057557] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-ea86d517-cc16-44bb-908a-85abce556c82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.057863] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-ea86d517-cc16-44bb-908a-85abce556c82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.058842] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea86d517-cc16-44bb-908a-85abce556c82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.198491] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.198767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.198826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.199100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.199216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.199449] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.199593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.199677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.199860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.199959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.200082] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b922414d-be26-4348-b82b-5fd8d10033d4 already deleted. [ 1041.200178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.264571] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.561031] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.566035] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.566262] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.566385] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.566649] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.566792] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.566943] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port ea86d517-cc16-44bb-908a-85abce556c82 not found, creating... [ 1041.567216] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.567370] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.567486] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.567696] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.567829] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.568116] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.568273] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.568389] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.568595] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.568725] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.568861] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: ea86d517-cc16-44bb-908a-85abce556c82 is going to be created. [ 1041.589977] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.590223] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.590352] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.590603] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.590829] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.591063] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-ea86d517-cc16-44bb-908a-85abce556c82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.767280] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.767480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.767523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.767749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.767842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.767949] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a5ed45f-6939-497b-9937-079be854fa2e is going to be created. [ 1041.812175] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.812175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.812175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.812175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.812175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.825066] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a5ed45f-6939-497b-9937-079be854fa2e in Status: UNINITIALIZED for 2s [ 1042.062599] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2e246f09-3adc-4e5b-92ef-400b3e3d4ada: rpc.has_security_group_logging(os_id): False [ 1042.082384] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.082540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.082613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.082863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.082956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.083229] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.083437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.083437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.083699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.083773] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.083888] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada is going to be created. [ 1042.152496] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.152688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.152788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.153062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.153249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.164220] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada in Status: IN_PROGRESS for 2s [ 1042.345760] env[65106]: INFO networking_nsxv3.common.synchronization [req-13023ac4-ac4c-46c5-98ea-b2dcaa117acb req-5ea1b8e8-cb96-4d80-9392-a5ec2a46578f service nova] Enqueued Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_rules [ 1042.346041] env[65106]: INFO networking_nsxv3.common.synchronization [req-13023ac4-ac4c-46c5-98ea-b2dcaa117acb req-5ea1b8e8-cb96-4d80-9392-a5ec2a46578f service nova] Enqueued Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_members [ 1042.346234] env[65106]: INFO networking_nsxv3.common.synchronization [req-13023ac4-ac4c-46c5-98ea-b2dcaa117acb req-5ea1b8e8-cb96-4d80-9392-a5ec2a46578f service nova] Enqueued Resource ID: ea86d517-cc16-44bb-908a-85abce556c82 with Priority: HIGHEST for action port [ 1042.346837] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_rules [ 1042.347077] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_members [ 1042.347238] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea86d517-cc16-44bb-908a-85abce556c82 with Priority: HIGHEST for action port [ 1042.347566] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b922414d-be26-4348-b82b-5fd8d10033d4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.347736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.347799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.348042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.348160] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.349532] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b922414d-be26-4348-b82b-5fd8d10033d4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.349658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.349728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.349921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.350173] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.350321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.350412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.350589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.350720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.350838] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.351729] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea86d517-cc16-44bb-908a-85abce556c82 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.351846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea86d517-cc16-44bb-908a-85abce556c82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.351889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea86d517-cc16-44bb-908a-85abce556c82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.352061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea86d517-cc16-44bb-908a-85abce556c82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.352150] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea86d517-cc16-44bb-908a-85abce556c82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.855403] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b922414d-be26-4348-b82b-5fd8d10033d4 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.855403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.855403] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.855777] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ea86d517-cc16-44bb-908a-85abce556c82 with status ACTIVE [ 1042.856028] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.856163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.856227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.856428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.856507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.856710] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.856767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.856813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.856995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.857119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.857300] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.857387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.857443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.857767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.857767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.857884] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ea86d517-cc16-44bb-908a-85abce556c82 is going to be updated. [ 1042.881307] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.881307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.881307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.881307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.881307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.881307] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea86d517-cc16-44bb-908a-85abce556c82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.360417] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.839088] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a5ed45f-6939-497b-9937-079be854fa2e in Status: SUCCESS [ 1043.839312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.839487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.839708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.839899] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.840030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.840096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.840242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.840315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.840420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.840495] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.864762] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.864931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.864999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.865218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.865319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.865392] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b922414d-be26-4348-b82b-5fd8d10033d4 is going to be created. [ 1043.889540] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.889684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.889749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.889963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.890131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.900443] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b922414d-be26-4348-b82b-5fd8d10033d4 in Status: UNINITIALIZED for 2s [ 1044.178622] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada in Status: SUCCESS [ 1044.178895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.350620] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a5ed45f-6939-497b-9937-079be854fa2e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.350855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.350855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.351136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.351306] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.351925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.351925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.351925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.351925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.351925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.352206] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a5ed45f-6939-497b-9937-079be854fa2e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.352206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.352206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.352419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.352511] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.352626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.352698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.352885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.352991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.353108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.353202] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.855715] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a5ed45f-6939-497b-9937-079be854fa2e: rpc.has_security_group_logging(os_id): False [ 1044.874921] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.875087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.875149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.875342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.875431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.875647] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.875749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.875817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.876063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.876063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.876241] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.876332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.876390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.876530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.876601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.876759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.876838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.876902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.877076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.877153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.877236] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a5ed45f-6939-497b-9937-079be854fa2e is going to be created. [ 1044.939167] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.939167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.939167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.939398] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.939602] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.955121] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a5ed45f-6939-497b-9937-079be854fa2e in Status: IN_PROGRESS for 2s [ 1045.263543] env[65106]: INFO networking_nsxv3.common.synchronization [req-777e8aee-f38f-484b-92e5-c160a41ea12a req-72ff9de3-731f-4e8c-8c5f-0cb14f25d041 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1045.264503] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1045.264836] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.265029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.265184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.265392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.265555] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.266136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.266291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.266402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.266770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.266770] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.635495] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.635688] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.635816] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.636239] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.636508] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.636664] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.636842] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.636989] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.637192] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.637414] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.637525] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.637623] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.637724] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.637872] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.637927] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.638067] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.658191] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.658368] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1045.658582] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.658772] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.659233] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-a6d91eb1-c11d-4461-872a-4df330225337 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.659433] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-a6d91eb1-c11d-4461-872a-4df330225337" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.659586] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-a6d91eb1-c11d-4461-872a-4df330225337" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.659884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-a6d91eb1-c11d-4461-872a-4df330225337" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.660040] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d91eb1-c11d-4461-872a-4df330225337',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.770343] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.770526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.770575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.770787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.770875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.771151] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.771320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.771444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.771704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.771852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.772027] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd already deleted. [ 1045.772194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.912503] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b922414d-be26-4348-b82b-5fd8d10033d4 in Status: SUCCESS [ 1045.912890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.913313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.913452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.913713] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.913871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.913967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.914227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.914315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.914437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.914565] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.134610] env[65106]: INFO networking_nsxv3.common.synchronization [req-67fab95a-99b5-4c5e-89a4-8df0b6408b4b req-326f4bb0-932f-4e3d-a32a-fa142df47927 tempest-ServersTestManualDisk-279691729 tempest-ServersTestManualDisk-279691729-project-member] Enqueued Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_members [ 1046.135356] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGHEST for action security_group_members [ 1046.135519] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.135764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.135764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.135896] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.136094] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.136186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.136243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.136401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.136483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.136576] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.162724] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.162975] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.163117] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.163434] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.163590] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.163741] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port a6d91eb1-c11d-4461-872a-4df330225337 not found, creating... [ 1046.164204] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.164204] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.164347] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.164564] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.164745] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.165079] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.165241] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.165354] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.165561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.165680] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.165820] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: a6d91eb1-c11d-4461-872a-4df330225337 is going to be created. [ 1046.185802] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.186105] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.186241] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.186513] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.186740] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.186972] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-a6d91eb1-c11d-4461-872a-4df330225337" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.417257] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.638581] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.638758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.638850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.639150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.639281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.639578] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.639687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.639756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.639924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.640049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.640187] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 is going to be updated. [ 1046.676548] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.676754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.676803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.677036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.677233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.688213] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 in Status: IN_PROGRESS for 2s [ 1046.921435] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b922414d-be26-4348-b82b-5fd8d10033d4: rpc.has_security_group_logging(os_id): False [ 1046.963243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.963534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.963534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.963752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.963857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.964155] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.964260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.964320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.964481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.964625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.964625] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b922414d-be26-4348-b82b-5fd8d10033d4 is going to be created. [ 1046.981144] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a5ed45f-6939-497b-9937-079be854fa2e in Status: SUCCESS [ 1046.981407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.988046] env[65106]: INFO networking_nsxv3.common.synchronization [req-777e8aee-f38f-484b-92e5-c160a41ea12a req-fe2acb76-9353-4f5c-86b0-1d72fac520a1 service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1046.988046] env[65106]: INFO networking_nsxv3.common.synchronization [req-777e8aee-f38f-484b-92e5-c160a41ea12a req-fe2acb76-9353-4f5c-86b0-1d72fac520a1 service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1046.988046] env[65106]: INFO networking_nsxv3.common.synchronization [req-777e8aee-f38f-484b-92e5-c160a41ea12a req-fe2acb76-9353-4f5c-86b0-1d72fac520a1 service nova] Enqueued Resource ID: a6d91eb1-c11d-4461-872a-4df330225337 with Priority: HIGHEST for action port [ 1046.989964] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1046.989964] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1046.989964] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6d91eb1-c11d-4461-872a-4df330225337 with Priority: HIGHEST for action port [ 1046.989964] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.990218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.990218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.990467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.990552] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.991472] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.991666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.991666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.991851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.992010] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.992109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.992172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.992317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.992390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.992478] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.994309] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6d91eb1-c11d-4461-872a-4df330225337 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.994418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6d91eb1-c11d-4461-872a-4df330225337" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.994483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6d91eb1-c11d-4461-872a-4df330225337" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.994638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6d91eb1-c11d-4461-872a-4df330225337" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.994716] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6d91eb1-c11d-4461-872a-4df330225337',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.077144] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.077376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.077628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.077741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.077868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.099337] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b922414d-be26-4348-b82b-5fd8d10033d4 in Status: IN_PROGRESS for 2s [ 1047.497330] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.497530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.497752] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.498747] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6d91eb1-c11d-4461-872a-4df330225337 with status ACTIVE [ 1047.498932] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.499164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.499243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.499506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.499624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.499859] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.499984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.499984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.501354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.501354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.501551] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.501686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.501726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.501881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.501959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.502154] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6d91eb1-c11d-4461-872a-4df330225337 is going to be updated. [ 1047.530644] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.530862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.530862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.531095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.531238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.531427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6d91eb1-c11d-4461-872a-4df330225337" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.005568] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.509174] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.509378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.509423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.509634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.509745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.509844] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be created. [ 1048.541880] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.543388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.543388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.543388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.543388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.553487] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: UNINITIALIZED for 2s [ 1048.700892] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 in Status: SUCCESS [ 1048.701082] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 deletion is rescheduled due to dependency. [ 1048.701203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.753977] env[65106]: INFO networking_nsxv3.common.synchronization [req-edc9bb23-c368-47fb-8a62-939dfb1df665 req-cbb612ba-66f3-4f45-a739-ff0031315a3b tempest-ServerAddressesNegativeTestJSON-826893249 tempest-ServerAddressesNegativeTestJSON-826893249-project-member] Enqueued Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGHEST for action security_group_members [ 1048.754847] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGHEST for action security_group_members [ 1048.754847] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f020ee1-e888-4331-aa52-96bec4612d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.754847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.754847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.755609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.755880] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.756077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.756188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.757238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.757238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.757409] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.099755] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-227 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.099755] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-227" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.099755] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-227" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.101312] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-227" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.101621] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.101793] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.101913] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.102196] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.102342] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.102548] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.102871] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1049.103278] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1049.103278] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1049.103278] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1049.103436] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1049.103476] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1049.119725] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b922414d-be26-4348-b82b-5fd8d10033d4 in Status: SUCCESS [ 1049.119956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.125535] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1049.125754] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1049.125934] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1049.126336] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-227" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.126823] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-b0710127-7991-4912-a7d8-b3a87ff7dc0c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.126959] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-b0710127-7991-4912-a7d8-b3a87ff7dc0c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.127039] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-b0710127-7991-4912-a7d8-b3a87ff7dc0c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.127336] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-b0710127-7991-4912-a7d8-b3a87ff7dc0c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.127476] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0710127-7991-4912-a7d8-b3a87ff7dc0c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.259772] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.260568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.260802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.261228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.261483] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.261636] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.261817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.262280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.262280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.262280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.262280] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f020ee1-e888-4331-aa52-96bec4612d2e already deleted. [ 1049.262280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.630031] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.630031] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.630214] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.630437] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.630611] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.630770] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port b0710127-7991-4912-a7d8-b3a87ff7dc0c not found, creating... [ 1049.631068] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.631274] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.631421] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.631681] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.631873] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.632254] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.632432] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.632550] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.632780] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.632944] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.633104] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: b0710127-7991-4912-a7d8-b3a87ff7dc0c is going to be created. [ 1049.656686] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.656686] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.656868] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.658607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.658607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.658607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-b0710127-7991-4912-a7d8-b3a87ff7dc0c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.501386] env[65106]: INFO networking_nsxv3.common.synchronization [req-edc9bb23-c368-47fb-8a62-939dfb1df665 req-61806791-c15c-4eb3-8a09-4e124c00b597 service nova] Enqueued Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGHEST for action security_group_rules [ 1050.501386] env[65106]: INFO networking_nsxv3.common.synchronization [req-edc9bb23-c368-47fb-8a62-939dfb1df665 req-61806791-c15c-4eb3-8a09-4e124c00b597 service nova] Enqueued Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGHEST for action security_group_members [ 1050.502324] env[65106]: INFO networking_nsxv3.common.synchronization [req-edc9bb23-c368-47fb-8a62-939dfb1df665 req-61806791-c15c-4eb3-8a09-4e124c00b597 service nova] Enqueued Resource ID: b0710127-7991-4912-a7d8-b3a87ff7dc0c with Priority: HIGHEST for action port [ 1050.507021] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGHEST for action security_group_rules [ 1050.507021] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGHEST for action security_group_members [ 1050.507302] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0710127-7991-4912-a7d8-b3a87ff7dc0c with Priority: HIGHEST for action port [ 1050.507844] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f020ee1-e888-4331-aa52-96bec4612d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.508079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.508198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.508721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.508879] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.510536] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f020ee1-e888-4331-aa52-96bec4612d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.510760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.510760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.510963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.511137] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.511231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.511310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.511437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.511535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.511637] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.512587] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0710127-7991-4912-a7d8-b3a87ff7dc0c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.512781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0710127-7991-4912-a7d8-b3a87ff7dc0c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.512781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0710127-7991-4912-a7d8-b3a87ff7dc0c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.512943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0710127-7991-4912-a7d8-b3a87ff7dc0c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.513075] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0710127-7991-4912-a7d8-b3a87ff7dc0c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.573384] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1050.573563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.573818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.574117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.576466] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.576466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.576466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.576466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.576466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.576466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.576466] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.015190] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0710127-7991-4912-a7d8-b3a87ff7dc0c with status ACTIVE [ 1051.015478] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.015974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.015974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.016105] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.016145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.016335] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.016445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.016509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.016713] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.016762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.016926] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.017034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.017097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.017237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.017312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.017391] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0710127-7991-4912-a7d8-b3a87ff7dc0c is going to be updated. [ 1051.019103] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f020ee1-e888-4331-aa52-96bec4612d2e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.019103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.019267] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.041275] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.041509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.041509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.041662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.041806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.041968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0710127-7991-4912-a7d8-b3a87ff7dc0c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.078924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.079142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.079230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.079498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.079674] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.079771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.079833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.079984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.080085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.080176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.080322] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.080412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.080471] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.080611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.080743] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.080832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.080889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.081081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.081176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.081300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.081482] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.522675] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.583372] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd: rpc.has_security_group_logging(os_id): False [ 1051.602593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.602916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.602916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.603119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.603226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.603484] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.603594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.603660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.603795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.603866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.604170] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.604301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.604371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.604533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.604632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.604898] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.605100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.605191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.605349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.605420] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.605507] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be created. [ 1051.680811] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.681083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.681248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.681579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.681831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.694470] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1052.025051] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.025293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.025391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.025615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.025677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.025791] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f020ee1-e888-4331-aa52-96bec4612d2e is going to be created. [ 1052.054662] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.054888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.054888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.056995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.056995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.072965] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f020ee1-e888-4331-aa52-96bec4612d2e in Status: UNINITIALIZED for 2s [ 1052.483794] env[65106]: INFO networking_nsxv3.common.synchronization [req-ebf99f22-6603-4bb0-b962-3037b8d5eebe req-32af80ec-b3c9-463d-8d9d-212b0fc2dcc1 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1052.484181] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1052.484543] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.484667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.484752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.485061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.485309] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.485412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.485412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.485821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.485821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.485821] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.872958] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.873338] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.874862] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.874862] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.874862] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.876137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.876137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.876137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.876137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.876459] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.876732] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1052.876867] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1052.877026] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1052.877253] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1052.877632] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1052.877632] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1052.901978] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1052.901978] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1052.901978] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1052.901978] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.902260] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-dbf89931-6800-49a9-9455-4d3736ec44d4 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.902357] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-dbf89931-6800-49a9-9455-4d3736ec44d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.902392] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-dbf89931-6800-49a9-9455-4d3736ec44d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.902717] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-dbf89931-6800-49a9-9455-4d3736ec44d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.902862] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf89931-6800-49a9-9455-4d3736ec44d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.990919] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.990919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.990919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.990919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.990919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.990919] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.990919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.990919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.990919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.990919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.990919] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be deleted. [ 1053.076650] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.076650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.076650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.076650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.076650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.076650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.410027] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.410027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.410027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.410027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.410027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.410027] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port dbf89931-6800-49a9-9455-4d3736ec44d4 not found, creating... [ 1053.410027] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.410027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.410027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.410027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.410027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.410610] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.410610] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.410883] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.411305] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.411567] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.411881] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: dbf89931-6800-49a9-9455-4d3736ec44d4 is going to be created. [ 1053.436370] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.436370] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.436370] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.436370] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.436983] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.437455] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-dbf89931-6800-49a9-9455-4d3736ec44d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.710931] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1053.710931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.088851] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f020ee1-e888-4331-aa52-96bec4612d2e in Status: SUCCESS [ 1054.089273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.089322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.089537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.089732] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.090184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.090184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.090184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.090184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.090501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.090501] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.204766] env[65106]: INFO networking_nsxv3.common.synchronization [req-ebf99f22-6603-4bb0-b962-3037b8d5eebe req-1b1f6a57-04f0-420e-8790-8ae03f9e66ef service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 1054.205082] env[65106]: INFO networking_nsxv3.common.synchronization [req-ebf99f22-6603-4bb0-b962-3037b8d5eebe req-1b1f6a57-04f0-420e-8790-8ae03f9e66ef service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1054.205325] env[65106]: INFO networking_nsxv3.common.synchronization [req-ebf99f22-6603-4bb0-b962-3037b8d5eebe req-1b1f6a57-04f0-420e-8790-8ae03f9e66ef service nova] Enqueued Resource ID: dbf89931-6800-49a9-9455-4d3736ec44d4 with Priority: HIGHEST for action port [ 1054.206299] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 1054.206506] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1054.206679] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbf89931-6800-49a9-9455-4d3736ec44d4 with Priority: HIGHEST for action port [ 1054.207143] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.207391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.207534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.207859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.208016] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.210132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.210318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.210423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.210723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.210986] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.211195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.211346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.211568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.211727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.211893] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.213208] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbf89931-6800-49a9-9455-4d3736ec44d4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.213390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbf89931-6800-49a9-9455-4d3736ec44d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.213515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbf89931-6800-49a9-9455-4d3736ec44d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.213992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbf89931-6800-49a9-9455-4d3736ec44d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.213992] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbf89931-6800-49a9-9455-4d3736ec44d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.595257] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f020ee1-e888-4331-aa52-96bec4612d2e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.595421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.595562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.595804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.596079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.596211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.596284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.596454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.596534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.596672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.596844] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f020ee1-e888-4331-aa52-96bec4612d2e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.596939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.597086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.597227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.597443] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.597610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.597610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.597775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.597816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.597896] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.597994] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.716110] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.716290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.717701] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.718822] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbf89931-6800-49a9-9455-4d3736ec44d4 with status ACTIVE [ 1054.719202] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.719429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.719593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.719833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.719923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.720123] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.720446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.720446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.720446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.720646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.720646] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.720731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.720794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.720928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.721130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.721259] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbf89931-6800-49a9-9455-4d3736ec44d4 is going to be updated. [ 1054.745056] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.745291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.745494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.745705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.745923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.746187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbf89931-6800-49a9-9455-4d3736ec44d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.048557] env[65106]: INFO networking_nsxv3.common.synchronization [req-122afc51-a136-440b-8cfd-2b7a470e0539 req-4b33b877-66c9-45f0-9c14-6e775a0a060e tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1055.049608] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1055.049608] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.049608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.049608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.050106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.050600] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.050797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.050907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.051201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.051278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.051410] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.100353] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1f020ee1-e888-4331-aa52-96bec4612d2e: rpc.has_security_group_logging(os_id): False [ 1055.120802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.121038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.121131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.121400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.121514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.121764] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.121915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.122313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.122313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.122313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.122573] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.122699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.122783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.122994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.123107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.123375] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.124251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.124251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.124251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.124251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.124251] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f020ee1-e888-4331-aa52-96bec4612d2e is going to be created. [ 1055.221037] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.221037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.221037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.221037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.221037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.223094] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.236987] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f020ee1-e888-4331-aa52-96bec4612d2e in Status: IN_PROGRESS for 2s [ 1055.545270] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.545270] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.545270] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.545270] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.545650] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.545910] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.546195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.547767] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.547983] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.548233] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.548346] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1055.548923] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1055.548923] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1055.548923] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1055.548923] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1055.549239] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1055.555955] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.556199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.556199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.556404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.557578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.557578] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.557578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.557578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.557578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.557578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.557578] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca already deleted. [ 1055.557578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.580519] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1055.580710] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1055.580843] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1055.580960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.581472] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-83dd85d7-e339-4a3c-97b3-3813507696e1 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.582197] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-83dd85d7-e339-4a3c-97b3-3813507696e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.582345] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-83dd85d7-e339-4a3c-97b3-3813507696e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.582761] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-83dd85d7-e339-4a3c-97b3-3813507696e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.582986] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83dd85d7-e339-4a3c-97b3-3813507696e1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.726794] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.727086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.727324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.727971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.727971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.727971] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be created. [ 1055.755743] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.755743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.755743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.755892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.755985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.768361] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: UNINITIALIZED for 2s [ 1056.085843] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.086169] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.086230] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.089137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.089137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.089137] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 83dd85d7-e339-4a3c-97b3-3813507696e1 not found, creating... [ 1056.089137] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.089137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.089137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.089137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.089137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.089137] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.089137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.089763] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.089763] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.093180] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.093556] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 83dd85d7-e339-4a3c-97b3-3813507696e1 is going to be created. [ 1056.117674] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.118057] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.123097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.123569] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.123832] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.124097] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-83dd85d7-e339-4a3c-97b3-3813507696e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.891923] env[65106]: INFO networking_nsxv3.common.synchronization [req-122afc51-a136-440b-8cfd-2b7a470e0539 req-d75e9025-755e-4df3-a8af-ee4a201a0755 service nova] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_rules [ 1056.892134] env[65106]: INFO networking_nsxv3.common.synchronization [req-122afc51-a136-440b-8cfd-2b7a470e0539 req-d75e9025-755e-4df3-a8af-ee4a201a0755 service nova] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1056.892294] env[65106]: INFO networking_nsxv3.common.synchronization [req-122afc51-a136-440b-8cfd-2b7a470e0539 req-d75e9025-755e-4df3-a8af-ee4a201a0755 service nova] Enqueued Resource ID: 83dd85d7-e339-4a3c-97b3-3813507696e1 with Priority: HIGHEST for action port [ 1056.892986] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_rules [ 1056.893162] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1056.893276] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83dd85d7-e339-4a3c-97b3-3813507696e1 with Priority: HIGHEST for action port [ 1056.893587] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.893729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.893798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.894021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.894786] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.895950] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.896096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.896161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.896381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.896741] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.896741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.896741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.896944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.896981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.898718] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.900133] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-83dd85d7-e339-4a3c-97b3-3813507696e1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.900658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83dd85d7-e339-4a3c-97b3-3813507696e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.900658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83dd85d7-e339-4a3c-97b3-3813507696e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.900754] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83dd85d7-e339-4a3c-97b3-3813507696e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.900754] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83dd85d7-e339-4a3c-97b3-3813507696e1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.253531] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1f020ee1-e888-4331-aa52-96bec4612d2e in Status: SUCCESS [ 1057.254085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.409117] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.410852] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.412577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.412577] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83dd85d7-e339-4a3c-97b3-3813507696e1 with status ACTIVE [ 1057.412577] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.412577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.412577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.412577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.412577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.412577] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.413279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.413522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.413873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.416912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.416912] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.416912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.416912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.416912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.416912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.416912] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83dd85d7-e339-4a3c-97b3-3813507696e1 is going to be updated. [ 1057.449329] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.449329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.449329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.449329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.449329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.449329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83dd85d7-e339-4a3c-97b3-3813507696e1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.597242] env[65106]: INFO networking_nsxv3.common.synchronization [req-eae1099e-79cf-4517-8448-c794c5443954 req-89248df6-7bbb-4d32-8d63-d8709d1c21b0 tempest-AttachVolumeShelveTestJSON-512943003 tempest-AttachVolumeShelveTestJSON-512943003-project-member] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_members [ 1057.597850] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGHEST for action security_group_members [ 1057.598231] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.599260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.599387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.599654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.599806] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.599925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.600035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.600204] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.600316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.600541] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.781422] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1057.781916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.781916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.782138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.782377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.782535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.783284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.783587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.783665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.783747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.783894] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.919057] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.106489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.106489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.106489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.106489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.106489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.106489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.106489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.106489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.106489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.106489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.106489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 is going to be updated. [ 1058.150580] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.150778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.150778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.150976] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.151139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.163319] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: IN_PROGRESS for 2s [ 1058.287942] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.288282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.288282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.288590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.288775] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.288879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.288943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.289111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.289200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.289287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.289446] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.289831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.290053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.290346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.290346] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.290462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.290617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.290921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.291190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.291190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.291327] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.423412] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.423664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.423664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.423906] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.424028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.424143] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca is going to be created. [ 1058.448948] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.449322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.449417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.449715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.449851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.461827] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: UNINITIALIZED for 2s [ 1058.796059] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cf4d8d-838b-4bef-8391-fb65a3ba9c75: rpc.has_security_group_logging(os_id): False [ 1058.821448] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.821667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.823512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.823639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.823693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.823963] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.824126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.824203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.824441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.824441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.824605] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.824701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.824763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.825014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.825014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.825286] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.825399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.825475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.825611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.825692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.825756] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be created. [ 1058.931406] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.934771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.934771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.934771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.934771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.954151] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1060.180439] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 in Status: SUCCESS [ 1060.180713] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 deletion is rescheduled due to dependency. [ 1060.180753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.476851] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: SUCCESS [ 1060.477095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.477354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.477633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.477834] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.477952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.478023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.478186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.478268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.478355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.478468] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.972575] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1060.972937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.981448] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.484342] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a2be5f5-efc1-4508-8ee3-6d684d4520ca: rpc.has_security_group_logging(os_id): False [ 1061.503576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.503837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.503837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.503994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.504102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.504355] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.504497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.504497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.504683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.504719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.504811] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca is going to be created. [ 1061.585571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.585803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.585803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.586027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.586185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.599329] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: IN_PROGRESS for 2s [ 1062.598683] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1062.598933] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1062.867358] env[65106]: INFO networking_nsxv3.common.synchronization [req-44625bd0-405e-4b82-85ab-497b173084b7 req-d044462e-6a37-46b1-a665-51e1b7853360 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1062.868165] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1062.868619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.868872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.870205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.870205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.870205] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.870205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.870205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.870423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.870568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.870715] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.228364] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.228628] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.228884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.229247] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.229915] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.229915] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.229915] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.230587] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.231148] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.231148] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.231331] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1063.231404] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1063.231558] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1063.231977] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1063.231977] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1063.232156] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1063.255947] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1063.256141] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1063.256300] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1063.256615] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.256798] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-7d608fbb-e305-4eed-ba44-39930263b9a9 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.257041] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-7d608fbb-e305-4eed-ba44-39930263b9a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.257195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-7d608fbb-e305-4eed-ba44-39930263b9a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.257625] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-7d608fbb-e305-4eed-ba44-39930263b9a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.257796] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d608fbb-e305-4eed-ba44-39930263b9a9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.374127] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.618569] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: SUCCESS [ 1063.618569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.762562] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.762990] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.763188] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.763534] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.763761] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.763982] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 7d608fbb-e305-4eed-ba44-39930263b9a9 not found, creating... [ 1063.764362] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.764563] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.764709] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.765051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.765339] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.765721] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.766697] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.766929] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.767245] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.768186] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.768484] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 7d608fbb-e305-4eed-ba44-39930263b9a9 is going to be created. [ 1063.797708] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.798081] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.798310] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.798664] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.798975] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.799691] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-7d608fbb-e305-4eed-ba44-39930263b9a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.880501] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.380653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.380855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.380958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.381701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.382302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.382302] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1064.419333] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.419333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.419333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.419333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.419333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.429013] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1064.598439] env[65106]: INFO networking_nsxv3.common.synchronization [req-44625bd0-405e-4b82-85ab-497b173084b7 req-ee18e01c-a56a-42e8-a219-add3f3a3162d service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1064.598694] env[65106]: INFO networking_nsxv3.common.synchronization [req-44625bd0-405e-4b82-85ab-497b173084b7 req-ee18e01c-a56a-42e8-a219-add3f3a3162d service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1064.599793] env[65106]: INFO networking_nsxv3.common.synchronization [req-44625bd0-405e-4b82-85ab-497b173084b7 req-ee18e01c-a56a-42e8-a219-add3f3a3162d service nova] Enqueued Resource ID: 7d608fbb-e305-4eed-ba44-39930263b9a9 with Priority: HIGHEST for action port [ 1064.599793] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1064.599793] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1064.599793] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d608fbb-e305-4eed-ba44-39930263b9a9 with Priority: HIGHEST for action port [ 1064.601796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.602852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.602852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.602852] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.602852] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.603458] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.603724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.603901] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d608fbb-e305-4eed-ba44-39930263b9a9 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.604811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d608fbb-e305-4eed-ba44-39930263b9a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.604811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d608fbb-e305-4eed-ba44-39930263b9a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.604811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d608fbb-e305-4eed-ba44-39930263b9a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.604811] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d608fbb-e305-4eed-ba44-39930263b9a9',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.107169] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.107510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.110284] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d608fbb-e305-4eed-ba44-39930263b9a9 with status ACTIVE [ 1065.110504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.110639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.110699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.111208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.111208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.111580] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.111715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.111776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.112200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.112200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.112673] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.112784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.112885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.113076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.113236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.113373] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d608fbb-e305-4eed-ba44-39930263b9a9 is going to be updated. [ 1065.137670] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.137813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.137877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.138156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.138301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.138458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d608fbb-e305-4eed-ba44-39930263b9a9" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.289548] env[65106]: INFO networking_nsxv3.common.synchronization [req-1e27b50d-a4e8-419f-8630-9c321039bf9e req-5af6f003-d605-46a3-b3d1-751b980cd3f7 tempest-ServerAddressesNegativeTestJSON-826893249 tempest-ServerAddressesNegativeTestJSON-826893249-project-member] Enqueued Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGHEST for action security_group_members [ 1066.290159] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGHEST for action security_group_members [ 1066.290493] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1f020ee1-e888-4331-aa52-96bec4612d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.290660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.290700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.291160] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.291506] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.291506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.291834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.292063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.292229] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.292380] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.439888] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1066.440336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.440405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.440612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.440807] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.440923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.440997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.441152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.441233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.441334] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.794458] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.794625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.794700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.794932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.795076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.795874] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.795874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.795874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.795874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.795874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.795874] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f020ee1-e888-4331-aa52-96bec4612d2e is going to be updated. [ 1066.849363] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.849593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.849593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.849831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.849981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.866448] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f020ee1-e888-4331-aa52-96bec4612d2e in Status: IN_PROGRESS for 2s [ 1066.943531] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.273178] env[65106]: INFO networking_nsxv3.common.synchronization [None req-bd59baa0-0dc7-4db1-8ab2-b8d138a2afec tempest-AttachVolumeShelveTestJSON-512943003 tempest-AttachVolumeShelveTestJSON-512943003-project-member] Enqueued Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_rules [ 1067.273771] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_rules [ 1067.274392] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.274521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.274582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.274939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.274939] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.288359] env[65106]: INFO networking_nsxv3.common.synchronization [req-7b3faf02-3a91-4b43-92c2-6b04a235b5e1 req-631e9d6e-6b15-4db0-a208-2cc8e236a167 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1067.289715] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1067.289715] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.289715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.289715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.289715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.289715] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.289715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.289715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.289715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.290277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.290277] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.434655] env[65106]: INFO networking_nsxv3.common.synchronization [None req-08eb0740-5401-469f-9957-a9efa46eafa4 tempest-AttachVolumeShelveTestJSON-512943003 tempest-AttachVolumeShelveTestJSON-512943003-project-member] Enqueued Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_rules [ 1067.434655] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_rules [ 1067.434655] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.434772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.446150] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.650108] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.650327] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.650408] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.650706] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.650958] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.651299] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.651299] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.651456] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.651596] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.651811] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.651926] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1067.652064] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1067.652182] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1067.652325] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1067.652436] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1067.652566] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1067.673710] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1067.673910] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1067.674070] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1067.674602] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.674602] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.674884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.675041] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.675719] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.676625] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a9176b-c3bb-4aa7-abed-4e98d0e6841c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.793795] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.793955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.794041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.794357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.794488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.794737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.794922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.795145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.795387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.795507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.795620] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c already deleted. [ 1067.795727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.796704] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.796833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.796875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.797053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.797132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.797218] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 already deleted. [ 1067.797298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.797493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.797652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.797735] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.948699] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.948929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.948929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.949213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.949350] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.949510] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1067.980558] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.980802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.980802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.981036] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.981189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.998901] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1068.179200] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.179200] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.179381] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.179546] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.180098] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.180098] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 96a9176b-c3bb-4aa7-abed-4e98d0e6841c not found, creating... [ 1068.180413] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.180413] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.180524] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.180794] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.181040] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.181632] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.185122] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.185277] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.185555] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.185708] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.185863] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 96a9176b-c3bb-4aa7-abed-4e98d0e6841c is going to be created. [ 1068.224998] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.225601] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.225601] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.225846] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.226216] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.226504] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.320861] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.321497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.321497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.321497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.321497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.321497] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 already deleted. [ 1068.321968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.878247] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1f020ee1-e888-4331-aa52-96bec4612d2e in Status: SUCCESS [ 1068.878247] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1f020ee1-e888-4331-aa52-96bec4612d2e deletion is rescheduled due to dependency. [ 1068.878247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.960358] env[65106]: INFO networking_nsxv3.common.synchronization [req-7b3faf02-3a91-4b43-92c2-6b04a235b5e1 req-32577a5c-e021-465a-b54e-e5a02b63d9af service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1068.960739] env[65106]: INFO networking_nsxv3.common.synchronization [req-7b3faf02-3a91-4b43-92c2-6b04a235b5e1 req-32577a5c-e021-465a-b54e-e5a02b63d9af service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1068.961012] env[65106]: INFO networking_nsxv3.common.synchronization [req-7b3faf02-3a91-4b43-92c2-6b04a235b5e1 req-32577a5c-e021-465a-b54e-e5a02b63d9af service nova] Enqueued Resource ID: 96a9176b-c3bb-4aa7-abed-4e98d0e6841c with Priority: HIGHEST for action port [ 1068.961657] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1068.962018] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1068.962269] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96a9176b-c3bb-4aa7-abed-4e98d0e6841c with Priority: HIGHEST for action port [ 1068.963677] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.963677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.963677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.963677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.963677] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.966216] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.966371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.966458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.966987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.966987] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.966987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.967144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.967290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.967405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.967526] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.968417] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.968812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.968812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.968812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.968812] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96a9176b-c3bb-4aa7-abed-4e98d0e6841c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.471306] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.471638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.472845] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.474111] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96a9176b-c3bb-4aa7-abed-4e98d0e6841c with status ACTIVE [ 1069.474313] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.474435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.474500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.474701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.474785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.474952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.475088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.475145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.475294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.475369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.475556] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.475651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.475710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.475845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.475916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.475998] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96a9176b-c3bb-4aa7-abed-4e98d0e6841c is going to be updated. [ 1069.500746] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.500901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.500973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.501378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.503912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.504143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96a9176b-c3bb-4aa7-abed-4e98d0e6841c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.979491] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.008575] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1070.008799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.009391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.009620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.009807] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.009925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.009991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.010165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.010231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.010317] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.010406] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.483580] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.486438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.486593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.486939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.487073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.487884] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be created. [ 1070.512080] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.512246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.512318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.512768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.512768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.513915] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.515389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.515389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.516178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.516597] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.516718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.516832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.517103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.517248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.517915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.517915] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.517915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.517915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.518203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.518564] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.518891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.519090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.519784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.519784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.519784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.519942] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.530692] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: UNINITIALIZED for 2s [ 1071.022515] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd: rpc.has_security_group_logging(os_id): False [ 1071.048164] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.050387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.050756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.050756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.050838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.051090] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.051221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.051283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.051479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.051559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.051797] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.051874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.051945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.052110] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.052207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.052394] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.052489] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.052605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.052691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.052751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.052834] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1071.117994] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.117994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.117994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.117994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.117994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.137030] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1072.543824] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1072.544082] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.544285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.544517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.544675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.544775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.544840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.544983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.545134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.545234] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.545356] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.693087] env[65106]: INFO networking_nsxv3.common.synchronization [req-98f85395-ffe8-483a-b861-61b71031a7eb req-ea55f058-2b1c-424f-9079-b1d07709de80 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1072.694096] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1072.694732] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.694732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.694732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.694979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.695060] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.695191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.695252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.695438] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.695526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.695620] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.048598] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.048801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.048876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.049154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.049337] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.049451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.049528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.049704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.049818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.049917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.050084] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.050180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.050242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.050401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.050546] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.050633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.050692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.050847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.050940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.051055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.053190] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.158325] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1073.158507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.198325] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.198497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.198538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.198748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.198840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.199071] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.199196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.199258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.199417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.199493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.199580] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1073.247187] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.247405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.247405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.247677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.247811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.263694] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1073.550664] env[65106]: INFO networking_nsxv3.common.synchronization [req-a9d81057-25ee-4723-8c0d-551fb5b9c53a req-63db64c3-b257-4484-b364-c44bc21f60d4 tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1073.551151] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1073.551460] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.551601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.551665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.551861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.552023] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.552125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.552198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.552346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.552430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.552524] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.553399] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8659458-b39f-4232-9cb7-76bba1a9081c: rpc.has_security_group_logging(os_id): False [ 1073.574123] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.574267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.574340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.574547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.574632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.574832] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.574928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.574990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.575201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.575281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.575464] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.575557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.575617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.575744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.575818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.575995] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.576119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.576167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.576292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.576670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.576804] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be created. [ 1073.636215] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.636397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.636397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.636574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.636804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.647958] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1074.056605] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.056864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.056909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.057150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.057245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.057439] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.057535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.057589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.057740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.057817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.057910] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1074.085693] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.085797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.085832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.086032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.086180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.094977] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1074.666618] env[65106]: INFO networking_nsxv3.common.synchronization [req-fe973ec5-6ea4-402c-97f0-b111955d115a req-b9f0c7da-a895-4c67-862c-79e23d8c84e4 tempest-AttachVolumeShelveTestJSON-512943003 tempest-AttachVolumeShelveTestJSON-512943003-project-member] Enqueued Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_members [ 1074.670022] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_members [ 1074.670022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.670022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.670022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.670022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.670022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.670022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.670022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.670022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.670022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.670022] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.060064] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.060498] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.060682] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.060966] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.061269] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.061488] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.061732] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.061979] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.062140] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.062364] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.062571] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1075.062624] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1075.062726] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1075.062836] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1075.062941] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1075.063091] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1075.083599] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1075.083888] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1075.084085] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1075.084271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.084591] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-efbd218b-c82a-4467-9d0e-d2f802cae287 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.084767] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.084885] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.085297] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.085439] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efbd218b-c82a-4467-9d0e-d2f802cae287',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.176059] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.176331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.176456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.176749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.176945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.177215] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.177419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.177520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.177876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.178070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.178192] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 already deleted. [ 1075.178407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.281437] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1075.281715] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 1075.281890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.588764] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.589015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.589153] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.589455] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.589622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.589779] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port efbd218b-c82a-4467-9d0e-d2f802cae287 not found, creating... [ 1075.590053] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.590216] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.590349] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.590574] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.590823] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.591240] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.591514] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.591639] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.591883] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.592063] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.592218] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: efbd218b-c82a-4467-9d0e-d2f802cae287 is going to be created. [ 1075.612800] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.613199] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.613617] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.613831] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.614103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.614401] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.677357] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1075.677684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.105447] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1076.105447] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 1076.105447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.333474] env[65106]: INFO networking_nsxv3.common.synchronization [req-fe973ec5-6ea4-402c-97f0-b111955d115a req-de20a42b-ee0f-401e-87aa-393cc68a918b service nova] Enqueued Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_rules [ 1076.333474] env[65106]: INFO networking_nsxv3.common.synchronization [req-fe973ec5-6ea4-402c-97f0-b111955d115a req-de20a42b-ee0f-401e-87aa-393cc68a918b service nova] Enqueued Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_members [ 1076.333650] env[65106]: INFO networking_nsxv3.common.synchronization [req-fe973ec5-6ea4-402c-97f0-b111955d115a req-de20a42b-ee0f-401e-87aa-393cc68a918b service nova] Enqueued Resource ID: efbd218b-c82a-4467-9d0e-d2f802cae287 with Priority: HIGHEST for action port [ 1076.334043] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_rules [ 1076.334181] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_members [ 1076.334283] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efbd218b-c82a-4467-9d0e-d2f802cae287 with Priority: HIGHEST for action port [ 1076.335235] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.335369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.335440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.335650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.335735] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.336760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.336890] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.336941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.337140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.337311] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.337392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.337453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.337600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.337687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.337781] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.338570] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-efbd218b-c82a-4467-9d0e-d2f802cae287 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.338679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.338776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.338892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.338966] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efbd218b-c82a-4467-9d0e-d2f802cae287',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.573175] env[65106]: INFO networking_nsxv3.common.synchronization [req-70de22b9-4a5b-41c9-941c-e014df0902d5 req-359e56e2-33b7-4105-b05c-59b4d207db73 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1076.573700] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1076.574107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.574255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.574334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.574551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.574713] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.574816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.574877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.575058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.575180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.575282] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.841608] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.841945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.841945] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.842978] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efbd218b-c82a-4467-9d0e-d2f802cae287 with status ACTIVE [ 1076.843112] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.843180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.843232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.843432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.843595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.843687] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.843780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.843845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.843999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.844088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.844296] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.844413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.844475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.844616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.844689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.844772] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efbd218b-c82a-4467-9d0e-d2f802cae287 is going to be updated. [ 1076.875956] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.876247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.876247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.876493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.876638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.876809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.077172] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.346948] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.579011] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.848833] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.849151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.849151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.849275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.849368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.849465] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 is going to be created. [ 1077.875289] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.875289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.875289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.875289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.875289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.884822] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: UNINITIALIZED for 2s [ 1078.081691] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.082480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.082480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.082480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.082480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.082480] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1078.120619] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.120782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.120859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.121203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.121369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.132239] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1079.897774] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: SUCCESS [ 1079.897774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.897774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.897774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.897774] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.897774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.897774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.897774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.897774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.898312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.898312] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.146500] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1080.147675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.155531] env[65106]: INFO networking_nsxv3.common.synchronization [req-9dd655e6-39b5-4091-b1d8-2f855baebe7c req-d90cc287-3858-4097-960b-e358d1ac5ef0 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_members [ 1080.156869] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGHEST for action security_group_members [ 1080.157287] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.157418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.157479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.157682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.157871] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.158061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.158198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.158469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.158601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.158778] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.401605] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.661385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.662079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.662079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.662079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.662079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.662079] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.662298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.662298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.662355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.662440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.662473] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 is going to be updated. [ 1080.688784] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.688922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.688971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.689720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.689923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.704217] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4372f393-06e7-4930-9ab6-1687d050de71 in Status: IN_PROGRESS for 2s [ 1080.903569] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed643b7d-1e4e-4399-802c-1e6860cd4cd5: rpc.has_security_group_logging(os_id): False [ 1080.923553] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.923652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.923868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.923964] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.924037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.924289] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.924413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.924466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.924587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.924651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.924741] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 is going to be created. [ 1081.006350] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.006591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.006717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.008151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.008312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.023575] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: IN_PROGRESS for 2s [ 1081.898327] env[65106]: INFO networking_nsxv3.common.synchronization [req-d657b47e-907f-421d-8de1-8d7a3ff27a41 req-41de1676-bdcb-46f8-953c-52ea2beb2753 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1081.899507] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1081.899885] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.899980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.900063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.900267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.900425] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.900524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.900586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.900733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.900823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.900914] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.405196] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.405626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.405626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.405626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.406017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.406017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.406135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.406300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.406359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.406413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.406509] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1082.441371] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.441537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.441605] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.441835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.441981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.454151] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1082.589309] env[65106]: INFO networking_nsxv3.common.synchronization [req-d5d4d87c-4077-4cb8-a432-dd8ff03537b2 req-dac450c1-57cf-43bb-b9d5-82be3c48aa65 tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1082.589309] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1082.589680] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.589881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.589975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.590771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.590771] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.590771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.591027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.591073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.591218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.591358] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.716168] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4372f393-06e7-4930-9ab6-1687d050de71 in Status: SUCCESS [ 1082.716499] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 deletion is rescheduled due to dependency. [ 1082.716631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.923028] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-155 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.923204] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.924083] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.924083] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.924083] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.924271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.924271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.924531] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.924704] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.924950] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.925127] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.925313] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.925446] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.925582] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.925719] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.925889] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.947568] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.947805] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.947997] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.948253] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-155" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.948633] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-622d048e-6abc-419c-aad1-9e7da4a3f36c taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.948976] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-622d048e-6abc-419c-aad1-9e7da4a3f36c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.949099] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-622d048e-6abc-419c-aad1-9e7da4a3f36c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.949491] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-622d048e-6abc-419c-aad1-9e7da4a3f36c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.949688] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('622d048e-6abc-419c-aad1-9e7da4a3f36c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.040022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: SUCCESS [ 1083.040298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.094671] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.094985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.095101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.095462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.095579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.095801] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.095931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.096023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.096203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.096316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.096392] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1083.138901] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.139029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.139106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.139325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.139473] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.149373] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1083.453142] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.453476] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.453532] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.453928] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.454180] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.454383] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 622d048e-6abc-419c-aad1-9e7da4a3f36c not found, creating... [ 1083.454692] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.454861] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.454979] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.455277] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.455436] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.455738] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.455894] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.456016] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.456277] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.456427] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.456569] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 622d048e-6abc-419c-aad1-9e7da4a3f36c is going to be created. [ 1083.485302] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.485899] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.486084] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.486729] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.486729] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.486989] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-622d048e-6abc-419c-aad1-9e7da4a3f36c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.191763] env[65106]: INFO networking_nsxv3.common.synchronization [req-d5d4d87c-4077-4cb8-a432-dd8ff03537b2 req-d6d91c16-df8c-4da6-aded-d8a37b181814 service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 1084.191763] env[65106]: INFO networking_nsxv3.common.synchronization [req-d5d4d87c-4077-4cb8-a432-dd8ff03537b2 req-d6d91c16-df8c-4da6-aded-d8a37b181814 service nova] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1084.191763] env[65106]: INFO networking_nsxv3.common.synchronization [req-d5d4d87c-4077-4cb8-a432-dd8ff03537b2 req-d6d91c16-df8c-4da6-aded-d8a37b181814 service nova] Enqueued Resource ID: 622d048e-6abc-419c-aad1-9e7da4a3f36c with Priority: HIGHEST for action port [ 1084.191763] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_rules [ 1084.191763] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1084.191763] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 622d048e-6abc-419c-aad1-9e7da4a3f36c with Priority: HIGHEST for action port [ 1084.191763] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.191763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.191763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.192190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.192190] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.192851] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.192939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.193138] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-622d048e-6abc-419c-aad1-9e7da4a3f36c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.193244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-622d048e-6abc-419c-aad1-9e7da4a3f36c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.193881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-622d048e-6abc-419c-aad1-9e7da4a3f36c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.193881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-622d048e-6abc-419c-aad1-9e7da4a3f36c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.193881] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('622d048e-6abc-419c-aad1-9e7da4a3f36c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.464967] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1084.465315] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c deletion is rescheduled due to dependency. [ 1084.465352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.695489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.695686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.695875] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 622d048e-6abc-419c-aad1-9e7da4a3f36c with status ACTIVE [ 1084.696065] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.696181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.696251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.696452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.696539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.696716] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.696811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.696873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.697042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.697122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.697301] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.697394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.697515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.697704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.697775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.697856] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 622d048e-6abc-419c-aad1-9e7da4a3f36c is going to be updated. [ 1084.723102] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.723384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.723384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.723540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.723681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.724077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-622d048e-6abc-419c-aad1-9e7da4a3f36c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.883434] env[65106]: INFO networking_nsxv3.common.synchronization [req-baa5226c-370f-4bc9-a7bb-2839a9efdf88 req-5ea9b678-746a-4c91-8580-3c0fd5fe11ff tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_members [ 1084.886119] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb with Priority: HIGHEST for action security_group_members [ 1084.887084] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-faa319fa-2be7-45e6-acc2-0f5f031e93fb taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.887084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.887084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.887556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.887556] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.887556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.889629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.889629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.889629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.889629] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('faa319fa-2be7-45e6-acc2-0f5f031e93fb',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.159588] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1085.159823] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 1085.159949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.160129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.160395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.160593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.160710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.160858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.160939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.161020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.161123] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.393631] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.393812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.393973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.394134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.429358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.429651] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.430667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.430667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.430667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.430667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.430667] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb is going to be updated. [ 1085.470519] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.470853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.470853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.470946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.471057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.485438] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb in Status: IN_PROGRESS for 2s [ 1085.664922] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.166722] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.669367] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.669675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.669675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.669675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.669785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.670520] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1086.703024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.703202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.703280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.703500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.703652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.713714] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1087.495697] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb in Status: SUCCESS [ 1087.495697] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: faa319fa-2be7-45e6-acc2-0f5f031e93fb deletion is rescheduled due to dependency. [ 1087.495836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-faa319fa-2be7-45e6-acc2-0f5f031e93fb" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.724366] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1088.724366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.724639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.724673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.725193] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.725193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.725193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.725193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.725466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.725466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.725466] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.227489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.227664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.227746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.228056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.228397] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.228519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.228582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.228762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.228849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.228987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.229179] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.229276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.229340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.229508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.229646] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.229764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.229847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.229994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.230174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.230260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.230363] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.733517] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00fc8ecc-2b12-478d-8a50-43a7183605bc: rpc.has_security_group_logging(os_id): False [ 1089.753414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.753570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.753630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.755316] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.755316] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.755316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.755952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.755952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.755952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.755952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.755952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.756132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.756132] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1089.828086] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.828291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.828362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.828593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.828774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.843880] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1089.887435] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1089.887435] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1091.443710] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.444035] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.444035] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.444304] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.444709] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.444880] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.445311] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.445311] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.445523] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.445856] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.445903] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.445997] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.446172] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.446349] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.446500] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.447053] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.468300] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.468472] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1091.468614] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.468785] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-600" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.469105] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-102e6ba6-09b7-4909-9fc3-d15768428dc6 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.469279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.469399] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.469653] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.469788] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('102e6ba6-09b7-4909-9fc3-d15768428dc6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.862375] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1091.862614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.972058] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.972293] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.972420] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.972710] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.972886] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.973199] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.973381] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.973501] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.974050] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.974241] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.974565] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.974755] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.974890] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.975123] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.975318] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.975455] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 102e6ba6-09b7-4909-9fc3-d15768428dc6 is going to be updated. [ 1091.997051] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.997360] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.997432] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.997808] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.998024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.998260] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.712483] env[65106]: INFO networking_nsxv3.common.synchronization [req-4e744465-5871-4ebd-a265-3ad03a688343 req-c71216ab-895e-4d98-afac-6ec6183ce14f service nova] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_rules [ 1092.712818] env[65106]: INFO networking_nsxv3.common.synchronization [req-4e744465-5871-4ebd-a265-3ad03a688343 req-c71216ab-895e-4d98-afac-6ec6183ce14f service nova] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1092.712818] env[65106]: INFO networking_nsxv3.common.synchronization [req-4e744465-5871-4ebd-a265-3ad03a688343 req-c71216ab-895e-4d98-afac-6ec6183ce14f service nova] Enqueued Resource ID: 102e6ba6-09b7-4909-9fc3-d15768428dc6 with Priority: HIGHEST for action port [ 1092.713484] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_rules [ 1092.713560] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1092.714033] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 102e6ba6-09b7-4909-9fc3-d15768428dc6 with Priority: HIGHEST for action port [ 1092.714033] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.714192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.714192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.714665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.714665] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.715739] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.715847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.715912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.716094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.716280] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.716378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.716460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.716631] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.716666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.718359] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.718359] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-102e6ba6-09b7-4909-9fc3-d15768428dc6 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.718359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.718359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.718601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.718601] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('102e6ba6-09b7-4909-9fc3-d15768428dc6',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.217097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.217319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.218581] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.221316] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 102e6ba6-09b7-4909-9fc3-d15768428dc6 with status ACTIVE [ 1093.221611] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.221779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.221885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.222223] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.222345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.222632] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.222791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.222895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.223183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.223330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.223628] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.223784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.223889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.224136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.224267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.224411] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 102e6ba6-09b7-4909-9fc3-d15768428dc6 is going to be updated. [ 1093.247806] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.248088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.248177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.248607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.248742] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.248874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-102e6ba6-09b7-4909-9fc3-d15768428dc6" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.720961] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.227240] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.227419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.227472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.227695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.227780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.227894] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be updated. [ 1094.274378] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.274378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.274660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.274728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.274911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.285949] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: IN_PROGRESS for 2s [ 1095.502109] env[65106]: INFO networking_nsxv3.common.synchronization [req-cd268415-8146-4042-934f-297e60be423e req-aa00fbed-6d0f-4ef4-9fbc-bcf7a26c7ee5 tempest-ServerDiskConfigTestJSON-924542691 tempest-ServerDiskConfigTestJSON-924542691-project-member] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1095.502683] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGHEST for action security_group_members [ 1095.502683] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.502898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.502898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.503137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.503726] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.503726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.503726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.503936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.503936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.503936] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.006352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.006527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.006604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.006809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.006900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.007121] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.007286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.007339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.007446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.007575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.007649] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be updated. [ 1096.038040] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.038040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.038256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.038346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.038492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.049410] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: IN_PROGRESS for 2s [ 1096.290639] env[65106]: INFO networking_nsxv3.common.synchronization [req-75eb641c-2d96-4606-a042-cbf789983c18 req-1734123d-aa01-45db-9db9-7e492fa0621c tempest-ImagesOneServerTestJSON-2038695469 tempest-ImagesOneServerTestJSON-2038695469-project-member] Enqueued Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGHEST for action security_group_members [ 1096.291215] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGHEST for action security_group_members [ 1096.291534] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a5ed45f-6939-497b-9937-079be854fa2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.291666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.291789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.291924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.292196] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.292313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.292372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.292612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.292612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.293366] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.297887] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 1096.298448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.298809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.299066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.299267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.299384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.299522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.299594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.299670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.299794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.299845] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.794946] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.795435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.795435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.795566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.795732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.795959] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.796078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.796141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.796335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.796441] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.796534] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a5ed45f-6939-497b-9937-079be854fa2e is going to be updated. [ 1096.802375] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.802535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.802579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.802726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.802879] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.802971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.803045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.803193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.803295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.803382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.803528] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.803607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.803672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.803883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.803947] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.804028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.804088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.804226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.804299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.804378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.804464] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.826269] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.826269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.826374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.827206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.827206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.835028] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a5ed45f-6939-497b-9937-079be854fa2e in Status: IN_PROGRESS for 2s [ 1097.307535] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff: rpc.has_security_group_logging(os_id): False [ 1097.331525] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.331525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.331525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.331943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.353374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.353654] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.353784] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.353854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.354075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.354173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.354375] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.354491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.354537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.354675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.354750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.354939] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.355086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.355086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.355367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.355490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.355556] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be updated. [ 1097.432863] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.432863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.432863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.433413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.433413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.448913] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: IN_PROGRESS for 2s [ 1098.061552] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc in Status: SUCCESS [ 1098.062039] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc deletion is rescheduled due to dependency. [ 1098.062039] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.482171] env[65106]: INFO networking_nsxv3.common.synchronization [None req-9a45e89b-91a7-4e6c-96af-12a295f655a0 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_rules [ 1098.482689] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_rules [ 1098.482974] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.483115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.483183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.483436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.483520] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.567701] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0df44c5f-6d2b-4e5e-a0aa-1338d22930b0 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_rules [ 1098.568423] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_rules [ 1098.568739] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.568841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.844741] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a5ed45f-6939-497b-9937-079be854fa2e in Status: SUCCESS [ 1098.844953] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a5ed45f-6939-497b-9937-079be854fa2e deletion is rescheduled due to dependency. [ 1098.845083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.006022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.006227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.006294] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.006547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.006644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.006740] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e already deleted. [ 1099.006823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.007016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.007203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.007310] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.467218] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 1099.467561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.529550] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.529730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.529768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.529969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.530078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.530175] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e already deleted. [ 1099.530272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.758569] env[65106]: INFO networking_nsxv3.common.synchronization [req-b9ae45b9-4230-477e-9fe2-6245dd9079c2 req-da77e6d3-4a3a-4ce1-89c1-54967be73d38 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1100.759185] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1100.759488] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.759599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.759683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.759922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.760244] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.760383] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.760452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.761132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.761231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.761351] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.102896] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.103110] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.103276] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.103559] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.104372] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.104372] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.104372] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.104372] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.104643] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.104643] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.104719] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1101.104827] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1101.104936] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1101.105040] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1101.105142] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1101.105307] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1101.125233] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1101.125547] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1101.125713] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1101.125892] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.126235] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.126509] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.126633] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.127019] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.127162] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f16fc846-02f7-4592-b0fc-bd4efb4cdfc4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.263342] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.263518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.263617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.263807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.263896] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.264125] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.264222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.264270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.264422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.264492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.264578] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1101.297081] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.297272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.297431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.297679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.297856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.307615] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1101.629731] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.629907] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.630063] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.630399] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.630562] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.630729] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port f16fc846-02f7-4592-b0fc-bd4efb4cdfc4 not found, creating... [ 1101.631059] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.631323] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.631484] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.631723] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.631898] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.632243] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.632420] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.632542] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.632876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.633059] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.633181] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: f16fc846-02f7-4592-b0fc-bd4efb4cdfc4 is going to be created. [ 1101.655063] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.655349] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.655485] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.655762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.655993] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.656234] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.401770] env[65106]: INFO networking_nsxv3.common.synchronization [req-b9ae45b9-4230-477e-9fe2-6245dd9079c2 req-52ce19bd-e39b-4244-9463-d73b98db41ce service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 1102.402061] env[65106]: INFO networking_nsxv3.common.synchronization [req-b9ae45b9-4230-477e-9fe2-6245dd9079c2 req-52ce19bd-e39b-4244-9463-d73b98db41ce service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1102.402118] env[65106]: INFO networking_nsxv3.common.synchronization [req-b9ae45b9-4230-477e-9fe2-6245dd9079c2 req-52ce19bd-e39b-4244-9463-d73b98db41ce service nova] Enqueued Resource ID: f16fc846-02f7-4592-b0fc-bd4efb4cdfc4 with Priority: HIGHEST for action port [ 1102.402730] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 1102.402877] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1102.402970] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f16fc846-02f7-4592-b0fc-bd4efb4cdfc4 with Priority: HIGHEST for action port [ 1102.403310] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.403436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.403523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.403785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.403890] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.404915] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.404915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.405083] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.405182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.405245] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.405491] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.405556] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f16fc846-02f7-4592-b0fc-bd4efb4cdfc4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.907766] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.908014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.908157] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f16fc846-02f7-4592-b0fc-bd4efb4cdfc4 with status ACTIVE [ 1102.908345] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.908455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.908525] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.908726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.908816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.908983] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.909109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.909177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.909318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.909528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.909724] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.909818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.909878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.910037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.910121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.910207] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f16fc846-02f7-4592-b0fc-bd4efb4cdfc4 is going to be updated. [ 1102.934960] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.935193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.935193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.935440] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.935582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.935750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f16fc846-02f7-4592-b0fc-bd4efb4cdfc4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.318916] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1103.319218] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 1103.319288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.319723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.319996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.320234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.320368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.320442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.320673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.320775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.320886] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.823040] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.190520] env[65106]: INFO networking_nsxv3.common.synchronization [req-17f3f617-bb24-47be-ac1c-9df2d08bcf18 req-7897c5a9-d994-44e9-9761-3294df1c2dec tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1104.191264] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1104.191670] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.191800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.191857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.192174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.192284] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.192417] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.192485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.192653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.192745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.192844] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.325845] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.558680] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.558936] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.559039] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.559395] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.560049] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.560049] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.560049] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.560365] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.560556] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.560802] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.560941] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1104.561081] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1104.561220] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1104.561389] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1104.561678] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1104.561864] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1104.582581] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1104.582766] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1104.582907] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1104.583102] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.583471] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-14bb2079-5959-4143-aa90-60e8a488520b taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.583648] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-14bb2079-5959-4143-aa90-60e8a488520b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.583767] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-14bb2079-5959-4143-aa90-60e8a488520b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.584137] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-14bb2079-5959-4143-aa90-60e8a488520b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.584286] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14bb2079-5959-4143-aa90-60e8a488520b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.695164] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.828802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.829149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.829149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.829248] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.829336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.829432] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1104.859490] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.859630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.860532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.860532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.860532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.869142] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1105.087339] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.087568] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.087723] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.088017] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.088433] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.088433] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 14bb2079-5959-4143-aa90-60e8a488520b not found, creating... [ 1105.088606] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.088755] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.089150] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.089150] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.089235] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.090042] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.090042] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.090042] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.090042] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.090257] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.090257] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 14bb2079-5959-4143-aa90-60e8a488520b is going to be created. [ 1105.110338] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.110621] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.110778] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.111054] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.111288] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.111512] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-14bb2079-5959-4143-aa90-60e8a488520b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.197475] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.701517] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.701517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.701517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.701517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.701517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.701517] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1105.728634] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.728769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.728840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.729072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.729221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.738141] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1105.804072] env[65106]: INFO networking_nsxv3.common.synchronization [req-17f3f617-bb24-47be-ac1c-9df2d08bcf18 req-4afd33e1-3b07-447f-846f-f64230d7fbbb service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1105.804072] env[65106]: INFO networking_nsxv3.common.synchronization [req-17f3f617-bb24-47be-ac1c-9df2d08bcf18 req-4afd33e1-3b07-447f-846f-f64230d7fbbb service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1105.804072] env[65106]: INFO networking_nsxv3.common.synchronization [req-17f3f617-bb24-47be-ac1c-9df2d08bcf18 req-4afd33e1-3b07-447f-846f-f64230d7fbbb service nova] Enqueued Resource ID: 14bb2079-5959-4143-aa90-60e8a488520b with Priority: HIGHEST for action port [ 1105.804459] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1105.804532] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1105.804674] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14bb2079-5959-4143-aa90-60e8a488520b with Priority: HIGHEST for action port [ 1105.804910] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.805148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.805148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.805266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.805512] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.806247] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.806358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.806535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-14bb2079-5959-4143-aa90-60e8a488520b taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.806667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14bb2079-5959-4143-aa90-60e8a488520b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.806667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14bb2079-5959-4143-aa90-60e8a488520b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.806869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14bb2079-5959-4143-aa90-60e8a488520b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.806942] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14bb2079-5959-4143-aa90-60e8a488520b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.309473] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.309847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.312077] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14bb2079-5959-4143-aa90-60e8a488520b with status ACTIVE [ 1106.312314] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.312492] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.312541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.312843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.312938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.313136] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.313326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.313375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.313533] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.313639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.313840] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.313973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.314065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.314272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.314389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.314503] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14bb2079-5959-4143-aa90-60e8a488520b is going to be updated. [ 1106.342312] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.342561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.342561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.342818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.342952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.343153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14bb2079-5959-4143-aa90-60e8a488520b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.880103] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1106.880327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.880497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.880721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.880916] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.881047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.881119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.881291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.881365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.881478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.881605] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.384575] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.384986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.384986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.385080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.385226] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.385368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.385439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.385603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.385692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.385781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.385925] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.386035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.386103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.386231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.386366] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.386472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.386551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.386691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.386765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.386845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.386932] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.756890] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1107.757215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.757392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.757651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.757908] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.758070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.758179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.758356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.758495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.758630] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.888707] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cf4d8d-838b-4bef-8391-fb65a3ba9c75: rpc.has_security_group_logging(os_id): False [ 1107.906932] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.907272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.907272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.907517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.907748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.908041] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.908159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.908366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.908646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.908732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.908932] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.909044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.909108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.909257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.909364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.909573] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.909677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.909739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.909883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.909969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.910067] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1107.981536] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.981683] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.981755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.981965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.982134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.997967] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1108.261404] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.765374] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.267883] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.268189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.268321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.268634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.268821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.269056] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1109.306623] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.306818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.306887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.307243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.307481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.319602] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1110.012592] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1110.012854] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.805758] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1110.805758] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1111.331184] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1111.331687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.333096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.333375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.333570] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.333687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.333771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.333921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.333987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.334090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.334180] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.838432] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.838432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.838432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.838979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.842977] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.842977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.842977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.842977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.842977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.842977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.842977] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.842977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.844020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.844020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.844020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.844020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.844020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.844500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.844757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.846104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.846104] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.349034] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd: rpc.has_security_group_logging(os_id): False [ 1112.366314] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.366474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.366592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.366760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.366857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.367084] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.367183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.367246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.367391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.367467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.367656] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.367757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.367822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.367963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.368050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.368231] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.368332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.368380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.368518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.368589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.368671] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1112.429293] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.429555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.429630] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.429847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.430009] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.446567] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1114.462360] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1114.462717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.806776] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1115.806776] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1116.046648] env[65106]: INFO networking_nsxv3.common.synchronization [req-09fad52f-9871-4d21-b070-42f90ebdac21 req-c02276df-a8f1-4fe4-a1aa-e8430bf34d16 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_members [ 1116.047196] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_members [ 1116.047856] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.047856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.047856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.047998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.048314] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.049084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.049084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.049084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.049084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.049084] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.410101] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.410411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.410558] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.410838] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.411220] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.411413] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.411533] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.411754] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.411891] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.412163] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.412289] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.412416] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.412539] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.412653] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.412837] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.412977] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.433425] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.433601] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.433925] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.434183] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.434675] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-141c003f-bb1d-4503-b215-795f21598f70 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.434946] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-141c003f-bb1d-4503-b215-795f21598f70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.435790] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-141c003f-bb1d-4503-b215-795f21598f70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.435790] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-141c003f-bb1d-4503-b215-795f21598f70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.435790] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('141c003f-bb1d-4503-b215-795f21598f70',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.550884] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.550884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.550884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.551117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.551150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.551969] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.551969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.551969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.551969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.551969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.551969] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e already deleted. [ 1116.551969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.908740] env[65106]: INFO networking_nsxv3.common.synchronization [req-31719f25-9931-40f4-ba69-73717b5c1eb5 req-a29351f5-f5b7-4292-82e6-6495e403e97a tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1116.909344] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1116.909672] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.909815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.910201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.910453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.910641] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.910758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.910836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.911033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.911132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.911242] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.938127] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.938346] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.938564] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.939783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.940024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.940218] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 141c003f-bb1d-4503-b215-795f21598f70 not found, creating... [ 1116.940502] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.940672] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.940847] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.941128] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.941311] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.941644] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.941831] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.941954] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.942240] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.942397] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.942566] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 141c003f-bb1d-4503-b215-795f21598f70 is going to be created. [ 1116.977465] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.977611] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.977783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.978127] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.978380] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.978675] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-141c003f-bb1d-4503-b215-795f21598f70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.415275] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.415769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.415769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.415981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.416041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.416336] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.416529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.416587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.416736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.416811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.416904] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1117.446540] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.446761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.446761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.447062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.447224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.458703] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1117.749612] env[65106]: INFO networking_nsxv3.common.synchronization [req-09fad52f-9871-4d21-b070-42f90ebdac21 req-34b96225-7497-4921-a3da-f72fc59f50d5 service nova] Enqueued Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_rules [ 1117.753020] env[65106]: INFO networking_nsxv3.common.synchronization [req-09fad52f-9871-4d21-b070-42f90ebdac21 req-34b96225-7497-4921-a3da-f72fc59f50d5 service nova] Enqueued Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_members [ 1117.753020] env[65106]: INFO networking_nsxv3.common.synchronization [req-09fad52f-9871-4d21-b070-42f90ebdac21 req-34b96225-7497-4921-a3da-f72fc59f50d5 service nova] Enqueued Resource ID: 141c003f-bb1d-4503-b215-795f21598f70 with Priority: HIGHEST for action port [ 1117.753020] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_rules [ 1117.753662] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_members [ 1117.757024] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 141c003f-bb1d-4503-b215-795f21598f70 with Priority: HIGHEST for action port [ 1117.757024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.757024] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.757024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.757024] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.757024] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.758169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.758281] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.762389] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-141c003f-bb1d-4503-b215-795f21598f70 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.762389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-141c003f-bb1d-4503-b215-795f21598f70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.762389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-141c003f-bb1d-4503-b215-795f21598f70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.762389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-141c003f-bb1d-4503-b215-795f21598f70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.762389] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('141c003f-bb1d-4503-b215-795f21598f70',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.960189] env[65106]: INFO networking_nsxv3.common.synchronization [req-7d4cfb5f-7b94-4fc5-9c34-2d9d3537c7a1 req-a6d2b292-3427-419f-917d-882f1137cd40 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1117.960189] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1117.960189] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.960189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.960189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.960940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.961234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.961717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.962505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.962505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.962505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.962505] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.261321] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.262929] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.263093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.263489] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 141c003f-bb1d-4503-b215-795f21598f70 with status ACTIVE [ 1118.263696] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.263808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.263874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.264252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.264442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.264649] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.264752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.264815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.264985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.265096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.265285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.265405] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.265539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.265728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.265872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.265913] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 141c003f-bb1d-4503-b215-795f21598f70 is going to be updated. [ 1118.296899] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.296899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.296899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.297069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.297221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.297446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-141c003f-bb1d-4503-b215-795f21598f70" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.466300] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.764586] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.969738] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.267761] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.267761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.268019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.268218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.268285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.268414] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e is going to be created. [ 1119.297407] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.297588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.297708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.297931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.298131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.318572] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e in Status: UNINITIALIZED for 2s [ 1119.472410] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1119.472410] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 1119.472410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.477048] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.477048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.477048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.477048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.477048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.477048] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1119.510320] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.510504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.510550] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.510727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.510874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.520658] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1119.536957] env[65106]: INFO networking_nsxv3.common.synchronization [req-8989caf7-8728-40cd-bc55-e6fd62ea0f08 req-b7718dfa-0034-48e7-99b3-765edac065ce tempest-ServerActionsV293TestJSON-556854681 tempest-ServerActionsV293TestJSON-556854681-project-member] Enqueued Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_members [ 1119.537563] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada with Priority: HIGHEST for action security_group_members [ 1119.537875] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.539232] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.539320] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.539666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.539966] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.539966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.540113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.540203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.540288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.540385] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2e246f09-3adc-4e5b-92ef-400b3e3d4ada',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.043427] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.043793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.043793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.043985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.044044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.044243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.044380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.044427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.044578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.044663] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.044752] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada is going to be updated. [ 1120.089379] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.089621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.089951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.090293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.090493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.105975] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada in Status: IN_PROGRESS for 2s [ 1121.349506] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e in Status: SUCCESS [ 1121.349815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.349867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.350096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.350346] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.350472] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.350538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.350702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.350778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.350859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.350949] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.532310] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1121.532560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.853924] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.121470] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada in Status: SUCCESS [ 1122.121647] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2e246f09-3adc-4e5b-92ef-400b3e3d4ada deletion is rescheduled due to dependency. [ 1122.121759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2e246f09-3adc-4e5b-92ef-400b3e3d4ada" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.355850] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 820bfc9e-ba46-4ec6-a32e-76e00c539d2e: rpc.has_security_group_logging(os_id): False [ 1122.374267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.374487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.374534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.374832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.374942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.375204] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.375326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.375369] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.375589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.375648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.375728] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e is going to be created. [ 1122.436986] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.437324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.437324] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.437495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.438139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.450255] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e in Status: IN_PROGRESS for 2s [ 1122.464718] env[65106]: INFO networking_nsxv3.common.synchronization [req-91624759-fb18-4697-a830-9a10ae8cda35 req-291f2938-7f65-481c-aa82-057815a9a73a tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_members [ 1122.465754] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b922414d-be26-4348-b82b-5fd8d10033d4 with Priority: HIGHEST for action security_group_members [ 1122.466790] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b922414d-be26-4348-b82b-5fd8d10033d4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.466790] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.466790] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.467062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.467259] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.467950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.467950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.467950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.468095] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.468226] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b922414d-be26-4348-b82b-5fd8d10033d4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.971892] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.971892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.971892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.971892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.971892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.972206] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.972206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.972206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.972338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.972390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.972469] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b922414d-be26-4348-b82b-5fd8d10033d4 is going to be updated. [ 1123.003080] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.003253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.003353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.003634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.003798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.012757] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b922414d-be26-4348-b82b-5fd8d10033d4 in Status: IN_PROGRESS for 2s [ 1124.462874] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e in Status: SUCCESS [ 1124.463255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.598291] env[65106]: INFO networking_nsxv3.common.synchronization [req-04a60bfd-0610-45a9-adb5-1382729696e1 req-8602cc11-6bc6-42d4-851e-327db6db8eff tempest-ServersNegativeTestJSON-2085709392 tempest-ServersNegativeTestJSON-2085709392-project-member] Enqueued Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1124.598790] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff with Priority: HIGHEST for action security_group_members [ 1124.599198] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.599299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.599299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.599494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.599641] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.599736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.599790] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.599934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.600028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.600119] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.023840] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b922414d-be26-4348-b82b-5fd8d10033d4 in Status: SUCCESS [ 1125.024011] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b922414d-be26-4348-b82b-5fd8d10033d4 deletion is rescheduled due to dependency. [ 1125.024080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b922414d-be26-4348-b82b-5fd8d10033d4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.102722] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.102895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.102938] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.103180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.103271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.103578] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.103706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.103785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.103944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.104033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.104126] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff is going to be updated. [ 1125.132857] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.132857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.132857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.132857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.132857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.141725] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: IN_PROGRESS for 2s [ 1127.158615] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff in Status: SUCCESS [ 1127.158953] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff deletion is rescheduled due to dependency. [ 1127.158953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.581924] env[65106]: INFO networking_nsxv3.common.synchronization [req-191a1d7b-4d4c-44bc-979e-c905b1525e90 req-39d62d29-ca6b-4854-9996-ce7c0fe0edb9 tempest-ServerActionsTestOtherB-878484751 tempest-ServerActionsTestOtherB-878484751-project-member] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1127.585050] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1127.585050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.585050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.585050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.585050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.585391] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.585391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.585391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.586624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.586757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.586831] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.092192] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.092192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.092192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.092430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.113596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.113676] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.113811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.113923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.114697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.114697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.114697] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 1128.152174] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.152337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.152337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.152556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.152702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.166828] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 1130.178021] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 1130.178021] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a deletion is rescheduled due to dependency. [ 1130.178021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.583031] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1132.583330] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1137.583738] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1137.583987] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1141.408015] env[65106]: INFO networking_nsxv3.common.synchronization [req-48bc7394-4a2e-487a-824a-ab440e0a8250 req-10dff816-415d-4819-9044-1078d1dcaec4 tempest-ServerRescueNegativeTestJSON-745464586 tempest-ServerRescueNegativeTestJSON-745464586-project-member] Enqueued Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_members [ 1141.408672] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGHEST for action security_group_members [ 1141.411227] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.411227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.411227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.411227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.411227] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.411227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.411227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.411227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.411227] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.411227] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.919070] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.919070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.919070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.919070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.919070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.919070] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.919070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.919070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.919070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.919070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.919070] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 is going to be updated. [ 1141.954097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.954097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.954097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.954097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.954097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.967860] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 in Status: IN_PROGRESS for 2s [ 1142.462171] env[65106]: INFO networking_nsxv3.common.synchronization [req-8cfdd3aa-2685-4ebb-8544-5e1a6ebba093 req-2b2dd406-a7c9-486c-8919-f89a6e87dfe0 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1142.462171] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1142.462864] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.463022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.463088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.463284] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.463490] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.463621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.463676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.463878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.463980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.464095] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.968785] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.968956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.968996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.969211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.969298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.969504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.969600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.969662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.969805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.969878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.969963] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1142.998102] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.999306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.999449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.999744] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.999952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.011592] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1143.385054] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-496 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.385284] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.385444] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.385793] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.386102] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.386271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.386399] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.386682] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.386848] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.387155] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.387284] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.387392] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.387497] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.387900] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.387900] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.388062] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.412521] env[65106]: INFO networking_nsxv3.common.synchronization [req-8eafdf2f-6fb3-40b3-8a82-18c42a403add req-43b642b9-5c95-42ce-852b-b5e9ce20aa73 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_members [ 1143.413248] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGHEST for action security_group_members [ 1143.413558] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.413742] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.414022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.414022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.414199] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.414271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.414334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.414477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.414563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.414670] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.416566] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.416726] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.417373] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.417373] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-496" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.417512] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-3a79cd82-cdb6-4973-a48b-c695d2beea29 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.417617] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-3a79cd82-cdb6-4973-a48b-c695d2beea29" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.417675] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-3a79cd82-cdb6-4973-a48b-c695d2beea29" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.418180] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-3a79cd82-cdb6-4973-a48b-c695d2beea29" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.418180] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a79cd82-cdb6-4973-a48b-c695d2beea29',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.844459] env[65106]: INFO networking_nsxv3.common.synchronization [req-026ca6cd-3156-4946-a1a4-7c49deed6f7c req-95f0e3b8-2181-49ca-86ad-6fd6c2edb709 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1143.845015] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1143.845657] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.845786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.845848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.846054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.846211] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.846326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.846391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.846502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.846624] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.846696] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.920541] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.920777] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.920893] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.921190] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.921340] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.921492] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 3a79cd82-cdb6-4973-a48b-c695d2beea29 not found, creating... [ 1143.921748] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.921902] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.922029] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.922250] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.922382] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.922673] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.922813] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.922925] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.923170] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.923302] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.923435] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 3a79cd82-cdb6-4973-a48b-c695d2beea29 is going to be created. [ 1143.924584] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.924707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.924750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.924891] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.924967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.925146] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.925238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.925296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.925434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.925509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.925638] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef is going to be updated. [ 1143.951848] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.952104] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.952457] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.952526] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.952765] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.953018] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-3a79cd82-cdb6-4973-a48b-c695d2beea29" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.963109] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.963274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.963347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.963679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.963914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.975521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aef9a0c3-8949-42e0-b152-6d0e475589ef in Status: IN_PROGRESS for 2s [ 1143.976034] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 in Status: SUCCESS [ 1143.976220] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 deletion is rescheduled due to dependency. [ 1143.976332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.351128] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.351309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.351443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.351745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.374604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.374939] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.375100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.375162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.375374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.375465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.375544] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1144.402802] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.403168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.403292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.403495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.403657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.413935] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1144.678729] env[65106]: INFO networking_nsxv3.common.synchronization [req-8cfdd3aa-2685-4ebb-8544-5e1a6ebba093 req-20675579-a020-4b0e-aca5-04f4c5faa0c1 service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 1144.678861] env[65106]: INFO networking_nsxv3.common.synchronization [req-8cfdd3aa-2685-4ebb-8544-5e1a6ebba093 req-20675579-a020-4b0e-aca5-04f4c5faa0c1 service nova] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1144.679030] env[65106]: INFO networking_nsxv3.common.synchronization [req-8cfdd3aa-2685-4ebb-8544-5e1a6ebba093 req-20675579-a020-4b0e-aca5-04f4c5faa0c1 service nova] Enqueued Resource ID: 3a79cd82-cdb6-4973-a48b-c695d2beea29 with Priority: HIGHEST for action port [ 1144.679283] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_rules [ 1144.679456] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1144.679510] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a79cd82-cdb6-4973-a48b-c695d2beea29 with Priority: HIGHEST for action port [ 1144.682015] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.682156] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.682222] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.682426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.682510] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.683837] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.683837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.684025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a79cd82-cdb6-4973-a48b-c695d2beea29 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.684114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a79cd82-cdb6-4973-a48b-c695d2beea29" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.684171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a79cd82-cdb6-4973-a48b-c695d2beea29" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.684347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a79cd82-cdb6-4973-a48b-c695d2beea29" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.684446] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a79cd82-cdb6-4973-a48b-c695d2beea29',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.807894] env[65106]: INFO networking_nsxv3.common.synchronization [req-80322750-cd37-43a1-8e29-9c44929da5ee req-f08481df-312f-4bfc-9906-89d1505c4a42 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1144.808881] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1144.809462] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.809898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.809898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.810187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.810966] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.811196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.811334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.811633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.811794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.811973] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.023487] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1145.023782] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 1145.023782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.024054] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.024176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.027578] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.027578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.027578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.027578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.027578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.027578] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.121327] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.121576] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.121809] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.122009] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.122363] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.122363] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.122526] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.122644] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.122774] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.123328] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.123328] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1145.123328] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1145.123328] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1145.123768] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1145.123768] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1145.123768] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1145.141855] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1145.143052] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1145.143052] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1145.143052] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.143052] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-f2a17343-3122-486d-b3bc-24d80704b182 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.143052] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-f2a17343-3122-486d-b3bc-24d80704b182" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.143305] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-f2a17343-3122-486d-b3bc-24d80704b182" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.143993] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-f2a17343-3122-486d-b3bc-24d80704b182" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.143993] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2a17343-3122-486d-b3bc-24d80704b182',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.188356] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.188356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.192010] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a79cd82-cdb6-4973-a48b-c695d2beea29 with status ACTIVE [ 1145.192010] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.192010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.192010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.192010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.192010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.192010] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.192010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.192010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.192010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.192010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.192544] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.192544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.192544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.192544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.192544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.192719] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a79cd82-cdb6-4973-a48b-c695d2beea29 is going to be updated. [ 1145.214179] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.214329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.214721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.214721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.214721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.215019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a79cd82-cdb6-4973-a48b-c695d2beea29" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.315590] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.529704] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.646378] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.646658] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.646803] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.647131] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.647351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.647427] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port f2a17343-3122-486d-b3bc-24d80704b182 not found, creating... [ 1145.648214] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.648398] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.648519] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.648746] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.648884] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.649205] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.649363] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.649478] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.649683] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.649824] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.649950] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: f2a17343-3122-486d-b3bc-24d80704b182 is going to be created. [ 1145.676056] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.676382] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.676537] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.676942] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.677270] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.677518] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-f2a17343-3122-486d-b3bc-24d80704b182" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.818620] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.985607] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aef9a0c3-8949-42e0-b152-6d0e475589ef in Status: SUCCESS [ 1145.985848] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef deletion is rescheduled due to dependency. [ 1145.985967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.032130] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.323490] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.323490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.323490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.323490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.323490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.323490] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1146.352632] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.352632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.352632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.352632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.352632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.364980] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1146.418439] env[65106]: INFO networking_nsxv3.common.synchronization [req-80322750-cd37-43a1-8e29-9c44929da5ee req-8f972c07-fea1-4900-8df0-9ebe1b4c45d6 service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1146.418439] env[65106]: INFO networking_nsxv3.common.synchronization [req-80322750-cd37-43a1-8e29-9c44929da5ee req-8f972c07-fea1-4900-8df0-9ebe1b4c45d6 service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1146.418439] env[65106]: INFO networking_nsxv3.common.synchronization [req-80322750-cd37-43a1-8e29-9c44929da5ee req-8f972c07-fea1-4900-8df0-9ebe1b4c45d6 service nova] Enqueued Resource ID: f2a17343-3122-486d-b3bc-24d80704b182 with Priority: HIGHEST for action port [ 1146.418439] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1146.418770] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1146.418997] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2a17343-3122-486d-b3bc-24d80704b182 with Priority: HIGHEST for action port [ 1146.419696] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.420041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.420199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.420481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.420653] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.421659] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.421898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.422225] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f2a17343-3122-486d-b3bc-24d80704b182 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.422446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f2a17343-3122-486d-b3bc-24d80704b182" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.422603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f2a17343-3122-486d-b3bc-24d80704b182" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.422869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f2a17343-3122-486d-b3bc-24d80704b182" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.423126] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f2a17343-3122-486d-b3bc-24d80704b182',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.425555] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1146.425945] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 deletion is rescheduled due to dependency. [ 1146.426147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.536671] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.536671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.536671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.536671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.536671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.536671] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1146.568947] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.568947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.568947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.568947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.568947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.578246] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1146.925952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.925952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.926267] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f2a17343-3122-486d-b3bc-24d80704b182 with status ACTIVE [ 1146.926267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.926428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.926428] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.926697] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.926787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.927056] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.927162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.927162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.927542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.927542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.927721] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.927721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.927721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.927878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.928077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.928125] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f2a17343-3122-486d-b3bc-24d80704b182 is going to be updated. [ 1146.949835] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.950093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.950093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.950268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.950391] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.950574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f2a17343-3122-486d-b3bc-24d80704b182" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.124724] env[65106]: INFO networking_nsxv3.common.synchronization [req-b191c681-fb84-4602-b7bd-631f8e28d197 req-db6389ce-ff6b-4c1a-9b62-5bcaa738d8de tempest-AttachVolumeTestJSON-98661006 tempest-AttachVolumeTestJSON-98661006-project-member] Enqueued Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_members [ 1147.125639] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGHEST for action security_group_members [ 1147.125960] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.126186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.126276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.126580] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.126679] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.126818] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.126902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.127233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.127319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.127374] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.151283] env[65106]: INFO networking_nsxv3.common.synchronization [req-f036e842-0b60-4339-a65f-bce71781d9c3 req-444e118d-c95d-414e-946d-36b853d362c0 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1147.151405] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1147.151930] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.151930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.151930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.152241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.152447] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.152594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.152594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.152753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.152801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.152853] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.529807] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.530017] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.530155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.530444] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.530725] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.530959] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.531122] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.531363] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.531529] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.531923] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.532057] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.532170] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.532371] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.532517] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.532628] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.532789] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.552050] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.552232] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1147.552607] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.552607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.552865] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-915d28ae-f133-416c-933e-dd7cdec83530 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.553051] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-915d28ae-f133-416c-933e-dd7cdec83530" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.553175] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-915d28ae-f133-416c-933e-dd7cdec83530" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.553508] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-915d28ae-f133-416c-933e-dd7cdec83530" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.553669] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('915d28ae-f133-416c-933e-dd7cdec83530',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.630571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.630863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.630863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.630979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.633175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.633483] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.633689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.633765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.633960] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.634055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.634398] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 is going to be updated. [ 1147.656093] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.656322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.656439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.656763] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.656899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.657194] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.657356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.657463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.657700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.657829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.657979] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 already deleted. [ 1147.658118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.664184] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.664401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.664401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.664641] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.664782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.681291] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c074b17-b18d-425c-b595-ed5504aae380 in Status: IN_PROGRESS for 2s [ 1148.057693] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.057960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.058122] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.058416] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.058568] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.058721] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 915d28ae-f133-416c-933e-dd7cdec83530 not found, creating... [ 1148.058984] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.059155] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.059272] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.059487] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.059620] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.059904] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.060071] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.060187] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.060401] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.060532] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.060669] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 915d28ae-f133-416c-933e-dd7cdec83530 is going to be created. [ 1148.080391] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.080711] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.080851] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.081224] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.081498] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.081760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-915d28ae-f133-416c-933e-dd7cdec83530" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.375523] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1148.376075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.376075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.376234] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.376409] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.376526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.376778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.376840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.376929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.377041] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.589087] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1148.589329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.589534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.589785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.590110] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.590255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.590323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.590487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.590568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.590704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.590879] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.809000] env[65106]: INFO networking_nsxv3.common.synchronization [req-f036e842-0b60-4339-a65f-bce71781d9c3 req-781a7ed8-7d79-4ee5-bca4-3b06a5e1720b service nova] Enqueued Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_rules [ 1148.809640] env[65106]: INFO networking_nsxv3.common.synchronization [req-f036e842-0b60-4339-a65f-bce71781d9c3 req-781a7ed8-7d79-4ee5-bca4-3b06a5e1720b service nova] Enqueued Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1148.809640] env[65106]: INFO networking_nsxv3.common.synchronization [req-f036e842-0b60-4339-a65f-bce71781d9c3 req-781a7ed8-7d79-4ee5-bca4-3b06a5e1720b service nova] Enqueued Resource ID: 915d28ae-f133-416c-933e-dd7cdec83530 with Priority: HIGHEST for action port [ 1148.810081] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_rules [ 1148.810262] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1148.810369] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 915d28ae-f133-416c-933e-dd7cdec83530 with Priority: HIGHEST for action port [ 1148.810713] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.810846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.810924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.811246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.811352] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.812465] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.812671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.812721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.812881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.813073] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.813190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.813275] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.813415] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.814152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.814152] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.815167] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-915d28ae-f133-416c-933e-dd7cdec83530 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.815167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-915d28ae-f133-416c-933e-dd7cdec83530" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.815167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-915d28ae-f133-416c-933e-dd7cdec83530" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.815423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-915d28ae-f133-416c-933e-dd7cdec83530" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.815495] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('915d28ae-f133-416c-933e-dd7cdec83530',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.879474] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.093542] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.093805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.093909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.094280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.094586] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.094768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.094876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.095219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.095370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.095526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.095865] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.095994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.096124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.096262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.096420] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.096519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.096652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.096837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.096908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.096998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.097104] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.318116] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.319592] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.319942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.322139] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 915d28ae-f133-416c-933e-dd7cdec83530 with status ACTIVE [ 1149.322338] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.322553] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.322596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.322837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.322969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.323225] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.323319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.323360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.323526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.323608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.323791] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.323877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.323933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.324084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.324800] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.324800] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 915d28ae-f133-416c-933e-dd7cdec83530 is going to be updated. [ 1149.348679] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.348679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.348679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.348679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.348679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.349290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-915d28ae-f133-416c-933e-dd7cdec83530" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.383893] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.599399] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a2cf4d8d-838b-4bef-8391-fb65a3ba9c75: rpc.has_security_group_logging(os_id): False [ 1149.619252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.619458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.619458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.619658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.619747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.619978] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.620139] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.620193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.620348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.620421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.620600] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.620691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.620795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.620895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.620956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.621168] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.621298] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.621384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.621634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.621634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.621694] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1149.691513] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c074b17-b18d-425c-b595-ed5504aae380 in Status: SUCCESS [ 1149.691674] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 deletion is rescheduled due to dependency. [ 1149.691752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.700837] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.701070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.701070] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.701365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.701456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.720883] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1149.821773] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.887063] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.887063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.887063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.887063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.887394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.887394] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1149.918352] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.918352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.918352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.918629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.918686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.931616] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1150.324700] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.324700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.324700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.325461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.325461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.325461] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 is going to be created. [ 1150.354658] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.355047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.355047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.355193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.355321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.366256] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: UNINITIALIZED for 2s [ 1151.739469] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1151.739716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.944798] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1151.945069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.945310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.945607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.945924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.946101] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.946201] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.946421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.946540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.946693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.946828] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.377019] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: SUCCESS [ 1152.377238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.377406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.377625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.377817] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.377932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.377991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.378173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.378251] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.378335] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.378424] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.449338] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.449494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.449642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.449805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.449976] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.450132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.450202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.450346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.450426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.450515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.450663] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.450755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.450814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.450972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.451125] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.451214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.451273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.451404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.451477] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.451556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.451642] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.881113] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.881461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.881461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.881728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.881903] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.882010] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.882080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.882236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.882322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.882407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.882562] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.882655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.882716] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.882857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.882994] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.883128] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.883191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.883329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.883402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.883481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.883587] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.953459] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd: rpc.has_security_group_logging(os_id): False [ 1153.053519] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.053786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.053869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.054141] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.054247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.054495] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.054597] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.054662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.054815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.054895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.055083] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.055198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.055230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.055370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.055443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.055618] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.055775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.055832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.055993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.056086] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.056187] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1153.127539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.127677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.127792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.128177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.128177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.147550] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1153.386143] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3689440-fdf4-4f9a-8a43-00a54e71ca10: rpc.has_security_group_logging(os_id): False [ 1153.406035] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.406035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.406035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.406281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.406281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.406438] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.407604] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.407604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.410117] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.410117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.410117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.410117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.410117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.410117] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 is going to be created. [ 1153.481388] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.481538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.481609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.481833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.482025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.494767] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: IN_PROGRESS for 2s [ 1153.811220] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1153.811328] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1155.162316] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1155.162614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.424741] env[65106]: INFO networking_nsxv3.common.synchronization [req-679fb3d1-78eb-4dbe-8760-b7e4d11056b1 req-c717c4f4-662a-4334-877f-3974116f8158 tempest-ServerActionsTestOtherB-878484751 tempest-ServerActionsTestOtherB-878484751-project-member] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1155.426683] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1155.426937] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.427031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.427065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.427502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.427502] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.427502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.427811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.427811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.427811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.427936] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.508682] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: SUCCESS [ 1155.508965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.722531] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-522 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.722727] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.722856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.723164] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.723420] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.723589] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.723792] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.724043] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.725630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.725630] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.725630] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1155.725630] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1155.725630] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1155.725630] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1155.725630] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1155.725630] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1155.744206] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1155.744376] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1155.744521] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1155.744776] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.745105] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-0c451b95-baf8-43e9-befe-13a6ea917c5f taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.745305] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.745430] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.745830] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.745975] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c451b95-baf8-43e9-befe-13a6ea917c5f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.930480] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.930480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.930480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.930723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.930723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.930856] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.930956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.931052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.931219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.931293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.931381] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 1155.958018] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.958202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.958244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.958611] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.958770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.967797] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 1156.249136] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.249643] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.249643] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.250692] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.250692] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.250692] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 0c451b95-baf8-43e9-befe-13a6ea917c5f not found, creating... [ 1156.251460] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.251460] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.251460] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.251859] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.251960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.252489] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.252704] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.253249] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.253249] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.253393] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.253614] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 0c451b95-baf8-43e9-befe-13a6ea917c5f is going to be created. [ 1156.290197] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.290515] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.290720] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.291056] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.291367] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.291585] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.990845] env[65106]: INFO networking_nsxv3.common.synchronization [req-679fb3d1-78eb-4dbe-8760-b7e4d11056b1 req-84d897be-94d6-4250-87a3-d5fe4c020664 service nova] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 1156.991042] env[65106]: INFO networking_nsxv3.common.synchronization [req-679fb3d1-78eb-4dbe-8760-b7e4d11056b1 req-84d897be-94d6-4250-87a3-d5fe4c020664 service nova] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1156.991225] env[65106]: INFO networking_nsxv3.common.synchronization [req-679fb3d1-78eb-4dbe-8760-b7e4d11056b1 req-84d897be-94d6-4250-87a3-d5fe4c020664 service nova] Enqueued Resource ID: 0c451b95-baf8-43e9-befe-13a6ea917c5f with Priority: HIGHEST for action port [ 1156.991759] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 1156.991893] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1156.991986] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c451b95-baf8-43e9-befe-13a6ea917c5f with Priority: HIGHEST for action port [ 1156.992320] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.992747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.992747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.992747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.992747] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.993598] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.993700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.994019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c451b95-baf8-43e9-befe-13a6ea917c5f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.994019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.994173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.994517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.994517] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c451b95-baf8-43e9-befe-13a6ea917c5f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.495806] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.496342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.496342] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c451b95-baf8-43e9-befe-13a6ea917c5f with status ACTIVE [ 1157.496342] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.496559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.496559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.496816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.496816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.496985] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.497085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.497142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.497301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.497532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.497683] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.497781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.497840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.498014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.498087] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.498156] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c451b95-baf8-43e9-befe-13a6ea917c5f is going to be updated. [ 1157.521850] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.522076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.522125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.522484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.522639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.522829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.978628] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 1157.979106] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a deletion is rescheduled due to dependency. [ 1157.979263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.979469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.979723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.980259] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.980418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.980516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.980729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.980840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.980961] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.134889] env[65106]: INFO networking_nsxv3.common.synchronization [req-27dbe4e0-6b5c-4167-bea1-37cc309790bb req-b21c577e-13af-4845-b2c9-0ac8438f760a tempest-ServerRescueNegativeTestJSON-745464586 tempest-ServerRescueNegativeTestJSON-745464586-project-member] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 1158.135491] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 1158.135491] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.135633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.135633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.135804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.135968] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.136342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.136468] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.136595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.136749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.136805] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.241951] env[65106]: INFO networking_nsxv3.common.synchronization [None req-fe1c9f2d-4de7-45a2-b1fc-0074ce517cf4 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_rules [ 1158.242204] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_rules [ 1158.242529] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.242661] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.242725] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.242990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.243090] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.377013] env[65106]: INFO networking_nsxv3.common.synchronization [None req-0b78bb9a-f30b-405d-a5a1-c3465f413d13 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_rules [ 1158.377763] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_rules [ 1158.377861] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.377941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.488828] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.639327] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.763945] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.764107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.764161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.764372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.764465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.764556] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 already deleted. [ 1158.764636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.764876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.765091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.765174] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.992938] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.142477] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.291934] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.292178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.292178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.293056] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.293152] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.293496] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 already deleted. [ 1159.293618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.496247] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.496247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.496247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.496247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.496247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.496247] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 1159.529519] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.529519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.529519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.529519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.529519] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.537329] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 1159.644732] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.645146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.645146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.645211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.645312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.645364] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be updated. [ 1159.677772] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.677927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.678041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.678221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.678362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.687883] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: IN_PROGRESS for 2s [ 1161.547977] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 1161.548370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.548370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.548580] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.548773] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.548893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.548955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.549126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.549200] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.549310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.549413] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.699243] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: SUCCESS [ 1161.699437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.051685] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.554545] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4755538-f7a6-45f7-9a19-37103260244a: rpc.has_security_group_logging(os_id): False [ 1162.572366] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.572527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.572598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.572812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.572902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.573162] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.573260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.573322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.573470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.573543] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.573647] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 1162.631232] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.631457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.631542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.631799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.631953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.644828] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 1163.378589] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1163.383821] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1164.662154] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 1164.662432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.379639] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1168.380021] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1169.412624] env[65106]: INFO networking_nsxv3.common.synchronization [req-8e79d915-d93d-4c39-ae36-987c6d32fbad req-9563dad6-7df9-45f0-8c92-35fccb5d8027 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1169.413475] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1169.414230] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.414455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.414493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.414690] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.414861] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.414985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.415061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.415247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.415334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.415431] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.539134] env[65106]: INFO networking_nsxv3.common.synchronization [req-44937fb8-7231-4e3c-944d-8195f7042e0c req-fe1abd80-f7ce-4546-a6d4-ed4882d14a57 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1169.539893] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1169.540131] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.540316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.542293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.542293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.542293] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.542293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.542293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.542293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.542293] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.542293] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.779057] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.779292] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.779423] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.779699] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.779958] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.780134] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.780250] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.780467] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.780870] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.781174] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.781313] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.781421] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.781531] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.781645] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.781751] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.781888] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.805316] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.805536] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.805762] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.806012] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.806380] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-02d1eee9-d893-4c5a-810b-10bdad8d92c1 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.806504] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-02d1eee9-d893-4c5a-810b-10bdad8d92c1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.806698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-02d1eee9-d893-4c5a-810b-10bdad8d92c1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.806972] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-02d1eee9-d893-4c5a-810b-10bdad8d92c1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.807125] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02d1eee9-d893-4c5a-810b-10bdad8d92c1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.868840] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.869055] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.869181] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.869444] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.869691] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.869845] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.869960] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.870190] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.870356] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.870567] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.870680] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.870785] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.870910] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.871037] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.871143] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.871270] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.888548] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.888699] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.017 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.888881] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.889116] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.889486] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-2de088b2-e7c6-4dad-95ac-b1237777a858 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.889662] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-2de088b2-e7c6-4dad-95ac-b1237777a858" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.889781] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-2de088b2-e7c6-4dad-95ac-b1237777a858" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.890150] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-2de088b2-e7c6-4dad-95ac-b1237777a858" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.890286] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2de088b2-e7c6-4dad-95ac-b1237777a858',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.917431] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.045933] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.047058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.047058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.047058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.047058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.047258] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.047258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.047343] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.047447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.047523] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.047608] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1170.082776] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.082993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.082993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.083195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.083341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.092320] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1170.309711] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.310086] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.310086] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.310439] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.310617] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.310800] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 02d1eee9-d893-4c5a-810b-10bdad8d92c1 not found, creating... [ 1170.311129] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.311315] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.311441] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.311701] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.311853] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.312204] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.312389] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.312516] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.312744] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.312902] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.313072] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 02d1eee9-d893-4c5a-810b-10bdad8d92c1 is going to be created. [ 1170.347253] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.347479] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.347583] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.347875] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.348247] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.348519] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-02d1eee9-d893-4c5a-810b-10bdad8d92c1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.392922] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.393195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.393320] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.393733] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.393988] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.394253] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 2de088b2-e7c6-4dad-95ac-b1237777a858 not found, creating... [ 1170.394641] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.394883] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.395067] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.395394] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.395599] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.396139] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.396385] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.396534] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.396843] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.397035] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.397235] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 2de088b2-e7c6-4dad-95ac-b1237777a858 is going to be created. [ 1170.419580] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.430227] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.430438] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.430591] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.430876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.431147] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.431377] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-2de088b2-e7c6-4dad-95ac-b1237777a858" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.922263] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.922389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.922436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.922648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.922743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.922846] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1170.966230] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.966445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.966488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.966687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.966863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.976257] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1171.046624] env[65106]: INFO networking_nsxv3.common.synchronization [req-8e79d915-d93d-4c39-ae36-987c6d32fbad req-2edad35c-ffa9-4980-92ac-552ff497f65b service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1171.046624] env[65106]: INFO networking_nsxv3.common.synchronization [req-8e79d915-d93d-4c39-ae36-987c6d32fbad req-2edad35c-ffa9-4980-92ac-552ff497f65b service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1171.046624] env[65106]: INFO networking_nsxv3.common.synchronization [req-8e79d915-d93d-4c39-ae36-987c6d32fbad req-2edad35c-ffa9-4980-92ac-552ff497f65b service nova] Enqueued Resource ID: 02d1eee9-d893-4c5a-810b-10bdad8d92c1 with Priority: HIGHEST for action port [ 1171.047381] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1171.047669] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1171.047910] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02d1eee9-d893-4c5a-810b-10bdad8d92c1 with Priority: HIGHEST for action port [ 1171.048450] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.048707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.048856] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.049178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.049372] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.050393] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.050618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.050923] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-02d1eee9-d893-4c5a-810b-10bdad8d92c1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.051272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02d1eee9-d893-4c5a-810b-10bdad8d92c1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.051434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02d1eee9-d893-4c5a-810b-10bdad8d92c1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.051705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02d1eee9-d893-4c5a-810b-10bdad8d92c1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.051911] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02d1eee9-d893-4c5a-810b-10bdad8d92c1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.131227] env[65106]: INFO networking_nsxv3.common.synchronization [req-44937fb8-7231-4e3c-944d-8195f7042e0c req-4bb86327-6755-46b4-b3a8-304ba9a0e605 service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1171.131227] env[65106]: INFO networking_nsxv3.common.synchronization [req-44937fb8-7231-4e3c-944d-8195f7042e0c req-4bb86327-6755-46b4-b3a8-304ba9a0e605 service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1171.131227] env[65106]: INFO networking_nsxv3.common.synchronization [req-44937fb8-7231-4e3c-944d-8195f7042e0c req-4bb86327-6755-46b4-b3a8-304ba9a0e605 service nova] Enqueued Resource ID: 2de088b2-e7c6-4dad-95ac-b1237777a858 with Priority: HIGHEST for action port [ 1171.131227] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1171.131227] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1171.131227] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2de088b2-e7c6-4dad-95ac-b1237777a858 with Priority: HIGHEST for action port [ 1171.131750] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.132022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.132190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.132547] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.132720] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.133651] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.133866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.134219] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-2de088b2-e7c6-4dad-95ac-b1237777a858 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.134445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2de088b2-e7c6-4dad-95ac-b1237777a858" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.134592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2de088b2-e7c6-4dad-95ac-b1237777a858" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.134863] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2de088b2-e7c6-4dad-95ac-b1237777a858" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.135071] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2de088b2-e7c6-4dad-95ac-b1237777a858',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.554419] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.554950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.555270] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 02d1eee9-d893-4c5a-810b-10bdad8d92c1 with status ACTIVE [ 1171.555576] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.555921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.556135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.556449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.556633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.556896] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.557129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.557292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.558041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.558041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.558041] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.558041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.558041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.558382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.558382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.558382] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 02d1eee9-d893-4c5a-810b-10bdad8d92c1 is going to be updated. [ 1171.583596] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.583823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.583823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.584072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.584215] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.584376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02d1eee9-d893-4c5a-810b-10bdad8d92c1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.637679] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.637679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.637679] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2de088b2-e7c6-4dad-95ac-b1237777a858 with status ACTIVE [ 1171.637679] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.637679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.638341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.638341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.638341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.638341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.638341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.638341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.638530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.638608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.639072] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.639072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.639072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.639072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.639072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.639262] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2de088b2-e7c6-4dad-95ac-b1237777a858 is going to be updated. [ 1171.675653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.675874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.675951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.676186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.676332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.676501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2de088b2-e7c6-4dad-95ac-b1237777a858" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.734608] env[65106]: INFO networking_nsxv3.common.synchronization [req-89de6076-fe0b-40a8-9d0f-d27c707ffc23 req-4b27fb8f-891d-4eac-967a-733087bf7451 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1171.734729] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1171.735057] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.735185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.735249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.735448] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.736041] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.736148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.736233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.736362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.736449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.736545] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.048630] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.048630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.048630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.048630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.049102] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.049102] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.049194] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.049383] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.049522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.049728] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.049836] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1172.049940] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1172.050057] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1172.050215] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1172.050298] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1172.050386] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1172.070438] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1172.070566] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1172.070702] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1172.070876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.071220] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-6826460d-e3af-400c-8f7d-1b45ada551bd taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.071394] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-6826460d-e3af-400c-8f7d-1b45ada551bd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.071513] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-6826460d-e3af-400c-8f7d-1b45ada551bd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.071838] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-6826460d-e3af-400c-8f7d-1b45ada551bd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.071981] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6826460d-e3af-400c-8f7d-1b45ada551bd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.101519] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1172.101678] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c deletion is rescheduled due to dependency. [ 1172.102954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.102954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.102954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.102954] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.102954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.102954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.102954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.102954] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.102954] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.239294] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.239505] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.239639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.239749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.239834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.240070] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.240189] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.240257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.240454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.240534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.240617] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1172.274537] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.274728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.274832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.275125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.275970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.289499] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1172.574496] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.574814] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.574893] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.575160] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.575316] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.575467] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 6826460d-e3af-400c-8f7d-1b45ada551bd not found, creating... [ 1172.575728] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.575945] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.576076] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.576292] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.576429] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.576755] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.576962] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.577107] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.577314] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.577445] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.578141] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 6826460d-e3af-400c-8f7d-1b45ada551bd is going to be created. [ 1172.598345] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.598545] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.598602] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.598877] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.599120] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.599342] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-6826460d-e3af-400c-8f7d-1b45ada551bd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.605107] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.986083] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1172.986213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.986360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.986581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.986777] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.986955] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.987045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.987214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.987296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.987396] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.106922] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.489727] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.609726] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.610288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.610288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.610288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.610288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.610526] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1173.646801] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.646991] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.647049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.647280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.647429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.665888] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1173.796922] env[65106]: INFO networking_nsxv3.common.synchronization [req-89de6076-fe0b-40a8-9d0f-d27c707ffc23 req-4aea3df3-2d03-4705-9874-8867745a03bc service nova] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 1173.796922] env[65106]: INFO networking_nsxv3.common.synchronization [req-89de6076-fe0b-40a8-9d0f-d27c707ffc23 req-4aea3df3-2d03-4705-9874-8867745a03bc service nova] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1173.796922] env[65106]: INFO networking_nsxv3.common.synchronization [req-89de6076-fe0b-40a8-9d0f-d27c707ffc23 req-4aea3df3-2d03-4705-9874-8867745a03bc service nova] Enqueued Resource ID: 6826460d-e3af-400c-8f7d-1b45ada551bd with Priority: HIGHEST for action port [ 1173.797429] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 1173.797620] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1173.797744] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6826460d-e3af-400c-8f7d-1b45ada551bd with Priority: HIGHEST for action port [ 1173.798192] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.798279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.798325] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.798563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.799383] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.800334] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.800932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.800932] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6826460d-e3af-400c-8f7d-1b45ada551bd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.800932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6826460d-e3af-400c-8f7d-1b45ada551bd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.800932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6826460d-e3af-400c-8f7d-1b45ada551bd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.801301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6826460d-e3af-400c-8f7d-1b45ada551bd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.801301] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6826460d-e3af-400c-8f7d-1b45ada551bd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.993463] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.069113] env[65106]: INFO networking_nsxv3.common.synchronization [req-a074709c-9972-40f8-9c96-4f2fc10f5a61 req-c47cc293-3079-4f54-8fc5-080908a9a6e5 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_members [ 1174.069752] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_members [ 1174.071175] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b8a1f4-4418-4fc5-8176-f9ec13d23327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.071308] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.071371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.071637] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.071818] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.071928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.071985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.072168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.072257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.072355] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.303101] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1174.303320] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 deletion is rescheduled due to dependency. [ 1174.303480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.304042] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.304185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.304249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.304501] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.304933] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.304933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.304933] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.305109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.305158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.305236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.305484] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.306331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.306656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.306854] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.307030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.307337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.307458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.307516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.308186] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.309678] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6826460d-e3af-400c-8f7d-1b45ada551bd with status ACTIVE [ 1174.309678] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.309678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.309678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.309678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.309678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.309678] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.309678] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.310113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.310113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.310113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.310285] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.310285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.310285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.310444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.310499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.311651] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6826460d-e3af-400c-8f7d-1b45ada551bd is going to be updated. [ 1174.336119] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.336338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.336379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.336595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.336750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.337067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6826460d-e3af-400c-8f7d-1b45ada551bd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.398323] env[65106]: INFO networking_nsxv3.common.synchronization [req-343b0308-abde-4c1f-bba9-9b05d31c7edc req-77367dcd-2c1c-4907-91d3-6ade4e3d7d48 tempest-ServerRescueNegativeTestJSON-745464586 tempest-ServerRescueNegativeTestJSON-745464586-project-member] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 1174.398980] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGHEST for action security_group_members [ 1174.399721] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.399721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.399721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.399883] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.399976] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.400147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.400249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.400439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.400521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.400615] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.497164] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.497460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.497460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.497753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.497753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.497849] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1174.533132] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.533328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.533392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.533563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.534396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.547906] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1174.574887] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.575093] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.575159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.575367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.575457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.575662] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.575761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.575973] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.576373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.576373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.576373] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 already deleted. [ 1174.576625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.667062] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.667364] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.667481] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.667653] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.667922] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.668229] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.668335] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.668606] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.668813] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.668979] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.669179] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1174.669353] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1174.669535] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1174.669720] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1174.669953] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1174.670131] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1174.692031] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1174.692031] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1174.692164] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1174.692350] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.692708] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-19cabe8f-56d4-4eb8-997d-0402d6699985 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.692885] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-19cabe8f-56d4-4eb8-997d-0402d6699985" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.693095] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-19cabe8f-56d4-4eb8-997d-0402d6699985" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.693439] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-19cabe8f-56d4-4eb8-997d-0402d6699985" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.693575] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19cabe8f-56d4-4eb8-997d-0402d6699985',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.809859] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.812628] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.903365] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.903518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.903589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.903867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.903944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.904171] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.904272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.904733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.904733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.904733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.904733] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be updated. [ 1174.960423] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.960601] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.960715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.961220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.961220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.984554] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: IN_PROGRESS for 2s [ 1175.196736] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.197171] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.197407] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.197819] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.198075] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.198332] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 19cabe8f-56d4-4eb8-997d-0402d6699985 not found, creating... [ 1175.198746] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.198989] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.199222] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.199561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.199779] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.200241] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.200492] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.200698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.201035] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.201270] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.201494] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 19cabe8f-56d4-4eb8-997d-0402d6699985 is going to be created. [ 1175.223090] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.223487] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.223720] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.224225] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.224607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.225017] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-19cabe8f-56d4-4eb8-997d-0402d6699985" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.312586] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8e3138f-71fe-44de-b062-382436a9dc63: rpc.has_security_group_logging(os_id): False [ 1175.316091] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.335591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.335943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.335943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.336165] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.336287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.336591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.336701] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.336861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.336916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.337055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.337211] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1175.418041] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.418041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.418041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.418041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.418041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.436051] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1175.677843] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1175.678170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.678260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.678464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.678659] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.678796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.678834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.678994] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.679083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.679168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.679262] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.817986] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.818216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.818289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.818555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.818652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.818756] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1175.851688] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.851893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.851998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.852265] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.852431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.863068] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1175.934602] env[65106]: INFO networking_nsxv3.common.synchronization [req-a074709c-9972-40f8-9c96-4f2fc10f5a61 req-8161d00e-14c8-481b-a4ef-5a1917c993c4 service nova] Enqueued Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_rules [ 1175.936041] env[65106]: INFO networking_nsxv3.common.synchronization [req-a074709c-9972-40f8-9c96-4f2fc10f5a61 req-8161d00e-14c8-481b-a4ef-5a1917c993c4 service nova] Enqueued Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_members [ 1175.936041] env[65106]: INFO networking_nsxv3.common.synchronization [req-a074709c-9972-40f8-9c96-4f2fc10f5a61 req-8161d00e-14c8-481b-a4ef-5a1917c993c4 service nova] Enqueued Resource ID: 19cabe8f-56d4-4eb8-997d-0402d6699985 with Priority: HIGHEST for action port [ 1175.936041] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_rules [ 1175.936041] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_members [ 1175.936041] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19cabe8f-56d4-4eb8-997d-0402d6699985 with Priority: HIGHEST for action port [ 1175.936570] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.936570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.936570] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.936753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.936753] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.937640] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b8a1f4-4418-4fc5-8176-f9ec13d23327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.937804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.937931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.938069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.938243] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.938363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.938423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.938949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.938949] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.938949] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.939648] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-19cabe8f-56d4-4eb8-997d-0402d6699985 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.939986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19cabe8f-56d4-4eb8-997d-0402d6699985" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.939986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19cabe8f-56d4-4eb8-997d-0402d6699985" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.939986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19cabe8f-56d4-4eb8-997d-0402d6699985" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.940259] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19cabe8f-56d4-4eb8-997d-0402d6699985',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.184627] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.184797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.184849] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.185194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.185387] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.185500] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.185555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.185720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.185867] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.185961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.186124] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.186214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.186274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.186415] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.186546] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.186632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.186686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.186828] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.186899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.186967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.187114] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.442315] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b8a1f4-4418-4fc5-8176-f9ec13d23327 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.442473] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.442627] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.443531] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19cabe8f-56d4-4eb8-997d-0402d6699985 with status ACTIVE [ 1176.443719] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.443914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.443989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.444202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.444285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.444451] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.446071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.446071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.446071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.446071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.446071] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.446071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.446071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.446071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.446071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.446071] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19cabe8f-56d4-4eb8-997d-0402d6699985 is going to be updated. [ 1176.469538] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.469835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.469835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.470018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.470191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.470367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19cabe8f-56d4-4eb8-997d-0402d6699985" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.558047] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1176.558255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.558430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.558647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.558845] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.558965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.559038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.559192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.559272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.559363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.559455] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.692612] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8659458-b39f-4232-9cb7-76bba1a9081c: rpc.has_security_group_logging(os_id): False [ 1176.712618] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.712835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.712835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.713065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.713162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.713386] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.713484] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.713542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.713738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.713810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.714014] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.714116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.714175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.714318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.714389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.714565] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.714658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.714708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.714835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.714996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.714996] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1176.776585] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.777059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.777059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.777167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.777256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.791976] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1176.947147] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.002404] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f20d6572-0b4b-48a0-8c23-2a251368deef in Status: SUCCESS [ 1177.002404] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef deletion is rescheduled due to dependency. [ 1177.002404] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.064533] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.065771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.065771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.065771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.066131] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.066399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.066607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.066967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.067656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.067656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.067656] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.067656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.067656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.068042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.068274] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.068462] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.068594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.069905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.069905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.069905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.069905] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.449721] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.449911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.449987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.450252] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.450350] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.450455] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 is going to be created. [ 1177.456061] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1177.456406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.479147] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.479406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.479499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.479715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.479878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.491134] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 in Status: UNINITIALIZED for 2s [ 1177.571708] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd: rpc.has_security_group_logging(os_id): False [ 1177.593648] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.593827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.593932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.594204] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.594321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.594647] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.594780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.594889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.595048] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.595147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.595369] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.595574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.595574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.595953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.596046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.596228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.596453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.596551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.596708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.596821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.596889] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1177.670572] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.670717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.670757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.670974] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.671137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.687334] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1177.700066] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-676 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.700400] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.700400] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.700656] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.700912] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.701084] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.701204] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.701420] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.701559] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.701758] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.701867] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1177.701974] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1177.702253] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1177.702446] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1177.702598] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1177.702752] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1177.722871] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1177.723153] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1177.723394] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1177.723634] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-676" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.724131] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-efbd218b-c82a-4467-9d0e-d2f802cae287 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.724404] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.724599] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.725014] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.725242] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efbd218b-c82a-4467-9d0e-d2f802cae287',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.872825] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1177.873055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.229216] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.229456] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.229580] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.229857] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.230079] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.230329] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.230490] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.230607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.230819] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.230951] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.231239] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.231389] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.231502] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.231696] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.231824] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.231958] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: efbd218b-c82a-4467-9d0e-d2f802cae287 is going to be updated. [ 1178.255554] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.255775] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.255955] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.256279] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.256476] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.256720] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.759837] env[65106]: INFO networking_nsxv3.common.synchronization [None req-646cac5b-0468-4f45-8020-a7e7d0b0218a tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1178.760454] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1178.760819] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.761346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.761346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.761346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.761496] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.761562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.761618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.761750] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.761838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.761928] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.806680] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1178.806940] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.004175] env[65106]: INFO networking_nsxv3.common.synchronization [req-8db2bebb-fc89-4d70-9faf-959f845dc460 req-2358ed5a-37bd-4398-a415-18f7072d99ad service nova] Enqueued Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_rules [ 1179.004381] env[65106]: INFO networking_nsxv3.common.synchronization [req-8db2bebb-fc89-4d70-9faf-959f845dc460 req-2358ed5a-37bd-4398-a415-18f7072d99ad service nova] Enqueued Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_members [ 1179.004496] env[65106]: INFO networking_nsxv3.common.synchronization [req-8db2bebb-fc89-4d70-9faf-959f845dc460 req-2358ed5a-37bd-4398-a415-18f7072d99ad service nova] Enqueued Resource ID: efbd218b-c82a-4467-9d0e-d2f802cae287 with Priority: HIGHEST for action port [ 1179.005123] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_rules [ 1179.005277] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_members [ 1179.005373] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efbd218b-c82a-4467-9d0e-d2f802cae287 with Priority: HIGHEST for action port [ 1179.005653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.005785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.005873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.006088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.006290] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.007240] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.007337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.007443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.007527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.007657] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.008874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.008874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.008874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.008874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.008874] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.009127] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-efbd218b-c82a-4467-9d0e-d2f802cae287 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.009127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.009127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.009738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.009738] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efbd218b-c82a-4467-9d0e-d2f802cae287',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.144536] env[65106]: INFO networking_nsxv3.common.synchronization [req-62009785-8c84-4f17-aeb3-485733d2db95 req-4cd75456-bc1c-4b7f-82cb-d2a9bf818802 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1179.145069] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1179.146249] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.146249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.146249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.146249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.146249] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.146249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.146249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.146249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.146589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.146589] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.264061] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.503601] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 in Status: SUCCESS [ 1179.503882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.504094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.504339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.504539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.504673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.504748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.504899] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.504981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.505081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.505265] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.512049] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.513442] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.513557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.513721] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efbd218b-c82a-4467-9d0e-d2f802cae287 with status ACTIVE [ 1179.513925] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.514058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.514203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.514452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.514583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.514781] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.514885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.515032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.515539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.515653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.515918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.516058] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.516144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.516322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.516495] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.516625] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efbd218b-c82a-4467-9d0e-d2f802cae287 is going to be updated. [ 1179.542828] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.542917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.542982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.543290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.543412] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.543662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efbd218b-c82a-4467-9d0e-d2f802cae287" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.648453] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.648988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.648988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.648988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.648988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.649252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.649318] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.649364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.649497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.649652] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.649652] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 is going to be updated. [ 1179.691717] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.691717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.691717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.691717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.691717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.703022] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: IN_PROGRESS for 2s [ 1179.717687] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1179.717687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.766058] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.007466] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.019048] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.268989] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.269269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.269366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.269788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.269788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.269896] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1180.316892] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.317057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.317131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.317388] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.317584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.331556] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1180.510427] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32b8a1f4-4418-4fc5-8176-f9ec13d23327: rpc.has_security_group_logging(os_id): False [ 1180.520936] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.521196] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.521681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.521681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.521681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.521918] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 is going to be updated. [ 1180.531116] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.531281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.531349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.531562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.531638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.531909] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.532078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.532184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.532392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.532506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.532605] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 is going to be created. [ 1180.568020] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.568178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.568178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.568468] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.568876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.580017] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: IN_PROGRESS for 2s [ 1180.625423] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.625689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.625689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.625869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.626120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.637632] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 in Status: IN_PROGRESS for 2s [ 1181.370539] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.370892] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.370954] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.371265] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.371545] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.371723] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.371841] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.372189] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.372411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.372689] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.372811] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.372958] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.373065] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.373195] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.373360] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.373567] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.399202] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.399445] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1181.399647] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.399801] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.400233] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-07080de5-c611-46eb-ba44-558c388a0fc7 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.400472] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-07080de5-c611-46eb-ba44-558c388a0fc7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.400602] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-07080de5-c611-46eb-ba44-558c388a0fc7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.400928] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-07080de5-c611-46eb-ba44-558c388a0fc7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.401405] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07080de5-c611-46eb-ba44-558c388a0fc7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.714381] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: SUCCESS [ 1181.714641] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 deletion is rescheduled due to dependency. [ 1181.714729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.904443] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.905659] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.905659] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.905659] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.905659] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.905659] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 07080de5-c611-46eb-ba44-558c388a0fc7 not found, creating... [ 1181.905882] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.905882] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.906048] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.906308] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.906468] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.906789] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.906997] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.907157] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.907374] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.907510] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.907653] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 07080de5-c611-46eb-ba44-558c388a0fc7 is going to be created. [ 1181.932996] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.932996] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.932996] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.932996] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.932996] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.933197] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-07080de5-c611-46eb-ba44-558c388a0fc7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.344514] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1182.346907] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.592500] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: SUCCESS [ 1182.592894] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.593140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.593187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.594233] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.594233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.594233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.594233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.594233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.594233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.594233] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.653062] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 in Status: SUCCESS [ 1182.653329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.718739] env[65106]: INFO networking_nsxv3.common.synchronization [req-f28984d1-51f7-4438-8c8c-0e6bc2f074b3 req-f5d27948-edb7-4928-be4a-a96e2e02ae13 service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1182.718739] env[65106]: INFO networking_nsxv3.common.synchronization [req-f28984d1-51f7-4438-8c8c-0e6bc2f074b3 req-f5d27948-edb7-4928-be4a-a96e2e02ae13 service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1182.718839] env[65106]: INFO networking_nsxv3.common.synchronization [req-f28984d1-51f7-4438-8c8c-0e6bc2f074b3 req-f5d27948-edb7-4928-be4a-a96e2e02ae13 service nova] Enqueued Resource ID: 07080de5-c611-46eb-ba44-558c388a0fc7 with Priority: HIGHEST for action port [ 1182.719536] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1182.719690] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1182.719823] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07080de5-c611-46eb-ba44-558c388a0fc7 with Priority: HIGHEST for action port [ 1182.720256] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.720431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.720463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.720710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.720831] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.722775] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.722775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.722775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.722775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.722775] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.722775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.722775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.723066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.723097] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.723241] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.724199] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-07080de5-c611-46eb-ba44-558c388a0fc7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.724315] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07080de5-c611-46eb-ba44-558c388a0fc7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.724379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07080de5-c611-46eb-ba44-558c388a0fc7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.724706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07080de5-c611-46eb-ba44-558c388a0fc7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.724706] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07080de5-c611-46eb-ba44-558c388a0fc7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.097446] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.226683] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.226920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.227071] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.227993] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07080de5-c611-46eb-ba44-558c388a0fc7 with status ACTIVE [ 1183.228159] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.228319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.228427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.228724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.228862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.229143] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.229285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.229353] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.229516] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.229632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.229770] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.229866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.229946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.230112] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.230185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.230268] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07080de5-c611-46eb-ba44-558c388a0fc7 is going to be updated. [ 1183.254281] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.254496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.254496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.254736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.254815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.254968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07080de5-c611-46eb-ba44-558c388a0fc7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.601233] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ed643b7d-1e4e-4399-802c-1e6860cd4cd5: rpc.has_security_group_logging(os_id): False [ 1183.621100] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.621100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.621100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.621100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.621100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.621572] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.621653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.621743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.621995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.622140] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.622279] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 is going to be updated. [ 1183.708910] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.709171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.709263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.709508] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.709712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.723281] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: IN_PROGRESS for 2s [ 1183.732829] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.235683] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.235923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.235923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.236194] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.236291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.236396] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1184.267049] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.268066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.268066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.268066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.268066] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.277222] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1185.738535] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: SUCCESS [ 1185.738924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.287632] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1186.287847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.288136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.288414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.288639] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.288760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.288827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.289014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.289096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.289168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.289271] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.791649] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.792084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.792084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.792084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.792228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.792332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.792390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.792540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.792629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.792748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.792927] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.793044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.793107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.793266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.793388] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.793513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.793579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.793815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.794090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.794090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.794090] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.296916] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8659458-b39f-4232-9cb7-76bba1a9081c: rpc.has_security_group_logging(os_id): False [ 1187.321267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.321538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.321538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.321698] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.321788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.322031] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.322132] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.322219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.322387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.322469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.322664] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.322760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.322834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.322987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.323077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.323262] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.323355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.323416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.323556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.323635] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.323719] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1187.402127] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.402356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.402356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.402588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.402738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.426671] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1187.720960] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1187.720960] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1188.978930] env[65106]: INFO networking_nsxv3.common.synchronization [None req-090f55be-bf56-4dc1-9807-a9eee3f436fc tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_rules [ 1188.979481] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_rules [ 1188.979793] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.979915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.979988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.980249] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.980375] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.097253] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d2a618d0-9093-4ec8-9897-179475623af9 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_rules [ 1189.097800] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_rules [ 1189.098382] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.098531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.444053] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1189.444289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.504729] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.504875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.504939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.505230] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.505322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.505426] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 already deleted. [ 1189.505514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.505669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.505837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.505957] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.030178] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.030546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.030546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.030625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.030658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.030868] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 already deleted. [ 1190.031014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.445599] env[65106]: INFO networking_nsxv3.common.synchronization [req-32362b29-6c1d-481a-b82f-820001042749 req-0d38a072-9096-4b79-b696-98e9948f6673 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1192.446143] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1192.446713] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.447148] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.447323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.447622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.453022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.453022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.453022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.453022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.453022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.453022] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.955315] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.458113] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.960691] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.960855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.960928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.961182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.961270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.961370] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1193.966055] env[65106]: INFO networking_nsxv3.common.synchronization [req-ebab24bb-f023-4663-bdde-7d91a71c2e9a req-20fe0208-c9b2-4938-b24b-75fada9631d9 tempest-DeleteServersTestJSON-1686995245 tempest-DeleteServersTestJSON-1686995245-project-member] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1193.966610] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGHEST for action security_group_members [ 1193.966913] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.967136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.967218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.967395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.967547] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.967645] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.967703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.967847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.967929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.968034] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.992246] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.992406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.992457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.992673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.992802] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.002977] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1194.469975] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.470431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.470431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.470431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.470580] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.470697] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.470789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.470843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.470987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.471079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.471162] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be updated. [ 1194.500235] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.500512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.500512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.500642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.501936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.514970] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: IN_PROGRESS for 2s [ 1195.089326] env[65106]: INFO networking_nsxv3.common.synchronization [req-3fff20fd-5551-43aa-b85a-13653ad15826 req-7e967d8b-f243-4bf7-ad02-cd065752fe2e tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_members [ 1195.090921] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_members [ 1195.090921] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.090921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.090921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.090921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.091377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.091377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.091377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.091535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.091571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.091837] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.421394] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.421394] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.421394] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.421665] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.421853] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.422024] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.422145] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.422385] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.422534] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.423029] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1195.423029] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1195.423029] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1195.423206] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1195.423206] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1195.423296] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1195.425460] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1195.450548] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1195.450731] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1195.450843] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1195.451026] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.451637] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-ba691f44-9ba1-45e9-9e85-3735afbf0294 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.451823] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-ba691f44-9ba1-45e9-9e85-3735afbf0294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.451941] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-ba691f44-9ba1-45e9-9e85-3735afbf0294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.452309] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-ba691f44-9ba1-45e9-9e85-3735afbf0294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.452446] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba691f44-9ba1-45e9-9e85-3735afbf0294',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.594535] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.594948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.594948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.595186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.595281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.595477] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.595574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.595634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.595777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.595848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.595947] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 already deleted. [ 1195.596092] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.955357] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.955504] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.955696] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.956180] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.956180] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.956362] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port ba691f44-9ba1-45e9-9e85-3735afbf0294 not found, creating... [ 1195.956594] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.956746] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.956855] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.958027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.958027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.958027] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.958027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.958027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.958027] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.958369] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.958369] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: ba691f44-9ba1-45e9-9e85-3735afbf0294 is going to be created. [ 1195.979568] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.979799] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.979921] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.980231] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.980572] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.980824] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-ba691f44-9ba1-45e9-9e85-3735afbf0294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.012511] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1196.012708] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.525689] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 in Status: SUCCESS [ 1196.525903] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 deletion is rescheduled due to dependency. [ 1196.526387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.700079] env[65106]: INFO networking_nsxv3.common.synchronization [req-3fff20fd-5551-43aa-b85a-13653ad15826 req-ca9f62ab-dab0-4c57-a0d8-6250cd9a4434 service nova] Enqueued Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_rules [ 1196.700446] env[65106]: INFO networking_nsxv3.common.synchronization [req-3fff20fd-5551-43aa-b85a-13653ad15826 req-ca9f62ab-dab0-4c57-a0d8-6250cd9a4434 service nova] Enqueued Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_members [ 1196.700446] env[65106]: INFO networking_nsxv3.common.synchronization [req-3fff20fd-5551-43aa-b85a-13653ad15826 req-ca9f62ab-dab0-4c57-a0d8-6250cd9a4434 service nova] Enqueued Resource ID: ba691f44-9ba1-45e9-9e85-3735afbf0294 with Priority: HIGHEST for action port [ 1196.700885] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_rules [ 1196.701061] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_members [ 1196.701180] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba691f44-9ba1-45e9-9e85-3735afbf0294 with Priority: HIGHEST for action port [ 1196.701594] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.701741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.701795] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.701977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.702049] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.702940] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.703261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.703261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.703409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.703439] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.703534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.703586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.704751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.704751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.704751] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.704751] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba691f44-9ba1-45e9-9e85-3735afbf0294 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.704751] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba691f44-9ba1-45e9-9e85-3735afbf0294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.705301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba691f44-9ba1-45e9-9e85-3735afbf0294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.705301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba691f44-9ba1-45e9-9e85-3735afbf0294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.705301] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba691f44-9ba1-45e9-9e85-3735afbf0294',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.149099] env[65106]: INFO networking_nsxv3.common.synchronization [req-c2b2929d-9b47-4d63-868c-4e6410af6d9f req-f7d690f4-c1a9-4b8b-ae19-e65ff03e2218 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1197.149673] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1197.150017] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.152414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.152414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.152414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.152414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.152414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.152414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.152655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.152825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.152899] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.206558] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba691f44-9ba1-45e9-9e85-3735afbf0294 with status ACTIVE [ 1197.206797] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.206931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.206996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.207243] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.207346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.207561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.207614] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.207743] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.207781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.207942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.208056] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.208175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.208303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.208374] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.208445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.208535] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba691f44-9ba1-45e9-9e85-3735afbf0294 is going to be updated. [ 1197.210333] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.211767] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.211848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.248088] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.248254] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.248328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.248555] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.248700] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.248870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba691f44-9ba1-45e9-9e85-3735afbf0294" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.655507] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.712711] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.157421] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.216050] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.216768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.216768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.216768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.216768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.216910] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 is going to be created. [ 1198.235549] env[65106]: INFO networking_nsxv3.common.synchronization [None req-fc52f9de-01a1-4190-8892-9edc1b9a2761 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1198.235928] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1198.236257] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.236356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.241270] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.241270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.241447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.241892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.242077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.253350] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 in Status: UNINITIALIZED for 2s [ 1198.662485] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.662658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.662699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.662917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.663020] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.663117] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1198.694316] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.694561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.694561] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.694702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.694841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.703474] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1198.937660] env[65106]: INFO networking_nsxv3.common.synchronization [req-4f9a2ab0-3d26-4af4-bde0-dba88adc9cee req-2848cda6-745d-4885-b82a-7f40b5bffa63 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1198.937660] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1198.938027] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.938199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.938296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.938509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.938668] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.938803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.938846] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.939127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.939127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.939248] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.441053] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.944017] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.263020] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 in Status: SUCCESS [ 1200.263253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.263421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.263851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.263851] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.264018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.264018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.264169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.264250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.264331] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.264420] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.448045] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.448045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.448045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.448045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.448045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.448045] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1200.481092] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.481312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.481312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.481978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.481978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.491012] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1200.714432] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1200.714646] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.714810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.715046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.715238] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.715366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.715421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.715566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.716714] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.716714] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.766914] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.849138] env[65106]: INFO networking_nsxv3.common.synchronization [req-a157c330-85c2-4bb7-93e9-7b1db3aef77d req-98ae26bf-ee79-4121-aa05-bce8b5822d0a tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_members [ 1200.849692] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e with Priority: HIGHEST for action security_group_members [ 1200.849993] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.850133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.850238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.850400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.850680] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.850680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.850760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.850840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.850923] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.851036] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('820bfc9e-ba46-4ec6-a32e-76e00c539d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.218139] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.218486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.218486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.218642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.218727] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.218924] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.219042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.219085] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.219237] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.219311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.219395] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1201.250760] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.250760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.250760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.250966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.251840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.260616] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1201.269914] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c5de97-57c7-4a3b-bcac-83d49995e933: rpc.has_security_group_logging(os_id): False [ 1201.296290] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.296509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.296509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.296702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.296781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.297102] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.297208] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.297269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.297443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.297560] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.297690] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 is going to be created. [ 1201.353057] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.353238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.353333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.353512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.353608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.353804] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.353901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.353977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.354199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.354279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.354367] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e is going to be updated. [ 1201.367612] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.367803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.367803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.368080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.368332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.386274] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 in Status: IN_PROGRESS for 2s [ 1201.397803] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.398482] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.398606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.398842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.400124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.409180] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e in Status: IN_PROGRESS for 2s [ 1202.501666] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1202.502108] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.271084] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1203.271084] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c deletion is rescheduled due to dependency. [ 1203.271084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.418572] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 in Status: SUCCESS [ 1203.418775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.426344] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e in Status: SUCCESS [ 1203.426548] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 820bfc9e-ba46-4ec6-a32e-76e00c539d2e deletion is rescheduled due to dependency. [ 1203.426677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-820bfc9e-ba46-4ec6-a32e-76e00c539d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.767098] env[65106]: INFO networking_nsxv3.common.synchronization [None req-ef95bd1d-281d-4b96-925d-b5a4a9ff1bbb tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_rules [ 1205.767098] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_rules [ 1205.767098] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.767696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.767696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.767759] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.767846] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.859443] env[65106]: INFO networking_nsxv3.common.synchronization [None req-83f36355-7d34-419b-a7a1-27f2369b669d tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_rules [ 1205.859937] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_rules [ 1205.860521] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.860521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.382756] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.383084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.383084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.383303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.383458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.383590] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 already deleted. [ 1206.383660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.383850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.384123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.384254] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.906402] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.906780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.906780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.906881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.906881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.906984] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 already deleted. [ 1206.907083] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.078510] env[65106]: INFO networking_nsxv3.common.synchronization [req-be255aac-cfc6-42cd-b960-3913560ba6a0 req-2cb40caf-da9e-4a49-a72e-9e976df2a518 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1210.079782] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1210.080165] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.080267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.080306] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.080503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.080661] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.080756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.080812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.080988] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.081100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.081197] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.444177] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.444491] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.444698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.445040] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.445400] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.445578] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.445699] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.445986] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.446184] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.446393] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.446507] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.446618] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.446726] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.446899] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.446998] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.447175] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.468477] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.468666] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1210.468809] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.468986] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.469326] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-32c943ce-09f9-4922-82f9-4255fe8d8731 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.469512] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-32c943ce-09f9-4922-82f9-4255fe8d8731" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.469840] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-32c943ce-09f9-4922-82f9-4255fe8d8731" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.470248] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-32c943ce-09f9-4922-82f9-4255fe8d8731" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.470472] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32c943ce-09f9-4922-82f9-4255fe8d8731',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.583141] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.973081] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.973313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.973431] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.973725] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.973876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.974083] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 32c943ce-09f9-4922-82f9-4255fe8d8731 not found, creating... [ 1210.974368] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.974595] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.974738] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.974964] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.975119] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.975470] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.975638] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.975760] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.975959] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.976164] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.976306] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 32c943ce-09f9-4922-82f9-4255fe8d8731 is going to be created. [ 1210.999195] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.999489] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.999643] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.999979] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.000277] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.000526] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-32c943ce-09f9-4922-82f9-4255fe8d8731" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.085646] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.587980] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.588182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.588241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.588577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.588692] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.588834] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1211.629475] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.629705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.629810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.630299] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.630494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.642702] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1211.723917] env[65106]: INFO networking_nsxv3.common.synchronization [req-be255aac-cfc6-42cd-b960-3913560ba6a0 req-6ce23205-5d22-4089-ba60-5cc169f7f02b service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1211.724143] env[65106]: INFO networking_nsxv3.common.synchronization [req-be255aac-cfc6-42cd-b960-3913560ba6a0 req-6ce23205-5d22-4089-ba60-5cc169f7f02b service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1211.724272] env[65106]: INFO networking_nsxv3.common.synchronization [req-be255aac-cfc6-42cd-b960-3913560ba6a0 req-6ce23205-5d22-4089-ba60-5cc169f7f02b service nova] Enqueued Resource ID: 32c943ce-09f9-4922-82f9-4255fe8d8731 with Priority: HIGHEST for action port [ 1211.724822] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1211.724956] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1211.725069] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32c943ce-09f9-4922-82f9-4255fe8d8731 with Priority: HIGHEST for action port [ 1211.725338] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.725461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.725514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.725712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.725790] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.726693] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.726817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.726983] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-32c943ce-09f9-4922-82f9-4255fe8d8731 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.727098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32c943ce-09f9-4922-82f9-4255fe8d8731" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.727173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32c943ce-09f9-4922-82f9-4255fe8d8731" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.727351] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32c943ce-09f9-4922-82f9-4255fe8d8731" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.727426] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32c943ce-09f9-4922-82f9-4255fe8d8731',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.229789] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.230202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.230266] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32c943ce-09f9-4922-82f9-4255fe8d8731 with status ACTIVE [ 1212.230513] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.230660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.230760] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.230990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.231164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.231290] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.231392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.231433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.231665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.231757] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.232019] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.232133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.232197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.232359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.232434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.232521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32c943ce-09f9-4922-82f9-4255fe8d8731 is going to be updated. [ 1212.257830] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.257830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.258100] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.258186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.258375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.258650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32c943ce-09f9-4922-82f9-4255fe8d8731" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.327968] env[65106]: INFO networking_nsxv3.common.synchronization [req-071190ef-c542-4526-96bb-cd3493763b1d req-3bab7835-8da0-462c-b85c-a260f57b1be1 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1212.329155] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1212.329612] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.329801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.329926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.330259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.330444] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.330569] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.330655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.330956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.331037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.331150] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.710204] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.710437] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.710562] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.710847] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.711148] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.711324] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.711453] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.711665] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.711806] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.712056] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.712162] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1212.712267] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1212.712370] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1212.712490] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1212.712603] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1212.712733] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1212.731473] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1212.731675] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1212.731826] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1212.732030] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.732358] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-00329129-7821-477a-b135-8d4f60f8a8d1 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.732545] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-00329129-7821-477a-b135-8d4f60f8a8d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.732677] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-00329129-7821-477a-b135-8d4f60f8a8d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.733032] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-00329129-7821-477a-b135-8d4f60f8a8d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.733225] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00329129-7821-477a-b135-8d4f60f8a8d1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.833994] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.834225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.834309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.834522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.834629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.834841] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.834951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.835027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.835207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.835303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.835405] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 already deleted. [ 1212.835493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.236373] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.236814] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.236814] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.237203] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.237454] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.237622] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 00329129-7821-477a-b135-8d4f60f8a8d1 not found, creating... [ 1213.237905] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.238103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.238227] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.238498] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.238683] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.238982] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.239174] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.239308] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.239530] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.239664] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.239824] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 00329129-7821-477a-b135-8d4f60f8a8d1 is going to be created. [ 1213.261195] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.261455] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.261577] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.261984] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.262578] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.262847] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-00329129-7821-477a-b135-8d4f60f8a8d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.652754] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1213.652977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.653158] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.653406] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.653593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.654174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.654174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.654174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.654174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.654174] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.971810] env[65106]: INFO networking_nsxv3.common.synchronization [req-071190ef-c542-4526-96bb-cd3493763b1d req-a01b2bb3-063c-45f0-b972-a8cc21adfed3 service nova] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_rules [ 1213.972070] env[65106]: INFO networking_nsxv3.common.synchronization [req-071190ef-c542-4526-96bb-cd3493763b1d req-a01b2bb3-063c-45f0-b972-a8cc21adfed3 service nova] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1213.972232] env[65106]: INFO networking_nsxv3.common.synchronization [req-071190ef-c542-4526-96bb-cd3493763b1d req-a01b2bb3-063c-45f0-b972-a8cc21adfed3 service nova] Enqueued Resource ID: 00329129-7821-477a-b135-8d4f60f8a8d1 with Priority: HIGHEST for action port [ 1213.972807] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_rules [ 1213.972964] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1213.973059] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00329129-7821-477a-b135-8d4f60f8a8d1 with Priority: HIGHEST for action port [ 1213.973362] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.973490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.973566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.973832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.973936] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.975084] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.975256] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.975333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.975544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.975741] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.975868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.975930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.976119] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.976211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.976308] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.977183] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-00329129-7821-477a-b135-8d4f60f8a8d1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.977290] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-00329129-7821-477a-b135-8d4f60f8a8d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.977373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-00329129-7821-477a-b135-8d4f60f8a8d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.977537] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-00329129-7821-477a-b135-8d4f60f8a8d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.977613] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('00329129-7821-477a-b135-8d4f60f8a8d1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.156327] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.481342] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.481748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.481748] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.483402] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 00329129-7821-477a-b135-8d4f60f8a8d1 with status ACTIVE [ 1214.483549] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.483549] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.483711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.483828] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.483913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.484305] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.484305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.484305] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.484442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.484506] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.484671] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.484780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.484837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.484979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.485064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.485153] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 00329129-7821-477a-b135-8d4f60f8a8d1 is going to be updated. [ 1214.507882] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.508584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.508711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.508895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.509035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.509205] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-00329129-7821-477a-b135-8d4f60f8a8d1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.659165] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.984233] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.162257] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.162450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.162450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.162639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.162753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.162857] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1215.194333] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.194521] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.194564] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.194839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.195008] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.203803] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1215.487563] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.488129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.488129] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.488211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.488323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.488470] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 is going to be created. [ 1215.512505] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.512811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.512811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.513125] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.513717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.523958] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: UNINITIALIZED for 2s [ 1217.224400] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1217.224739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.224841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.225098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.225313] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.225447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.225514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.225689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.225776] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.225869] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.225971] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.533727] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: SUCCESS [ 1217.534018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.534207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.534419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.534606] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.534726] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.534792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.534945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.535038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.535124] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.535216] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.727987] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.728286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.728286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.728445] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.728597] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.728699] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.728764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.728914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.728997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.729103] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.729248] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.729336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.729395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.729531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.729666] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.729753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.729813] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.729946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.730030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.730120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.730209] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.037033] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.232947] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd: rpc.has_security_group_logging(os_id): False [ 1218.253290] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.253538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.253538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.253779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.253875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.254206] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.254311] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.254377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.254536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.254615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.254815] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.254939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.254990] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.255180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.255255] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.255438] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.255531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.255592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.255733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.255892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.255892] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1218.319103] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.319332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.319419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.319734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.319920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.347434] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1218.540580] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96c24dfa-dab7-474a-b4bc-2b49c584c9f3: rpc.has_security_group_logging(os_id): False [ 1218.559067] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.559268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.559430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.559681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.559768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.560067] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.560155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.560211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.560370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.560446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.560537] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 is going to be created. [ 1218.619675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.619902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.619902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.620111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.620295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.632529] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: IN_PROGRESS for 2s [ 1218.974690] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1218.974902] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1220.365271] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1220.366278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.644125] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: SUCCESS [ 1220.644347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.040470] env[65106]: INFO networking_nsxv3.common.synchronization [req-89841568-f7b3-4ba3-949a-611784444df0 req-fe55bcb3-407d-4685-821b-fdfd8087515a tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1223.041596] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1223.041596] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.041596] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.041817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.041817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.042957] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.043135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.043210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.043381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.043461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.043563] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.546121] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.049549] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.552337] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.552520] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.552563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.552892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.552998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.553184] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1224.580843] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.581021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.581068] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.581292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.581444] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.590668] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1226.601815] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1226.602195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.929456] env[65106]: INFO networking_nsxv3.common.synchronization [req-ccaf152b-6b41-4e7e-a802-c807b9cae3ec req-fb34e255-b462-4329-808d-a5f7214eae59 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1226.930062] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1226.930382] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.930527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.930581] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.930765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.930919] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.931035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.931094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.931239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.931321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.931413] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.225047] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.225254] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.225378] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.225653] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.225921] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.226115] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.226277] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.226495] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.226672] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.226926] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1227.227050] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1227.227158] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1227.227261] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1227.227365] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1227.227462] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1227.227596] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1227.246398] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1227.246586] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1227.247064] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1227.247064] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.247286] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-36f9980c-4697-484b-9049-c46bc0642620 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.247456] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-36f9980c-4697-484b-9049-c46bc0642620" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.247532] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-36f9980c-4697-484b-9049-c46bc0642620" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.247876] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-36f9980c-4697-484b-9049-c46bc0642620" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.247962] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36f9980c-4697-484b-9049-c46bc0642620',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.436042] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.750721] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.751159] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.751159] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.751327] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.751476] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.751634] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 36f9980c-4697-484b-9049-c46bc0642620 not found, creating... [ 1227.751884] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.752047] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.752164] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.752372] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.752504] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.752771] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.752926] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.753055] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.753260] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.753390] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.753536] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 36f9980c-4697-484b-9049-c46bc0642620 is going to be created. [ 1227.773832] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.774037] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.774166] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.774431] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.774650] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.774864] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-36f9980c-4697-484b-9049-c46bc0642620" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.938782] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.441674] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.441895] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.442016] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.442280] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.442400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.442521] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 is going to be updated. [ 1228.474025] env[65106]: INFO networking_nsxv3.common.synchronization [req-ccaf152b-6b41-4e7e-a802-c807b9cae3ec req-4b8221e7-b866-432d-948a-b766764443f2 service nova] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_rules [ 1228.474025] env[65106]: INFO networking_nsxv3.common.synchronization [req-ccaf152b-6b41-4e7e-a802-c807b9cae3ec req-4b8221e7-b866-432d-948a-b766764443f2 service nova] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1228.474174] env[65106]: INFO networking_nsxv3.common.synchronization [req-ccaf152b-6b41-4e7e-a802-c807b9cae3ec req-4b8221e7-b866-432d-948a-b766764443f2 service nova] Enqueued Resource ID: 36f9980c-4697-484b-9049-c46bc0642620 with Priority: HIGHEST for action port [ 1228.475256] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.475418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.475463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.475659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.475819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.477602] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_rules [ 1228.477742] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1228.477849] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f9980c-4697-484b-9049-c46bc0642620 with Priority: HIGHEST for action port [ 1228.478119] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.478218] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.478287] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.478450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.478562] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.479967] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.479967] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.480107] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-36f9980c-4697-484b-9049-c46bc0642620 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.481047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36f9980c-4697-484b-9049-c46bc0642620" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.481047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36f9980c-4697-484b-9049-c46bc0642620" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.481047] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36f9980c-4697-484b-9049-c46bc0642620" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.481047] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36f9980c-4697-484b-9049-c46bc0642620',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.490758] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: IN_PROGRESS for 2s [ 1228.980445] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.980840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.981880] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36f9980c-4697-484b-9049-c46bc0642620 with status ACTIVE [ 1228.982136] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.982283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.982394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.982633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.982728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.982942] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.983073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.983203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.983422] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.983494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.983685] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.983779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.983836] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.983979] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.984071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.984152] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36f9980c-4697-484b-9049-c46bc0642620 is going to be updated. [ 1229.007709] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.007924] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.007978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.008217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.008401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.008615] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36f9980c-4697-484b-9049-c46bc0642620" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.500847] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: SUCCESS [ 1230.501283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.501283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.501481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.501698] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.501821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.501902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.502102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.502191] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.502292] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.005967] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.507295] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.009678] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.009920] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.009993] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.010240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.010332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.010433] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 is going to be updated. [ 1232.037723] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.037892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.037931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.038163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.038310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.047843] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: IN_PROGRESS for 2s [ 1233.479106] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1233.479435] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1234.060784] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: SUCCESS [ 1234.060999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.061198] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.061425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.061625] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.061745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.061810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.061968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.062059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.062149] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.062409] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.565522] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.037625] env[65106]: INFO networking_nsxv3.common.synchronization [req-ef5d3068-4c26-4269-a8b6-26bfed44bae5 req-638a64a2-ff8a-4883-92ee-8128547f6400 tempest-AttachVolumeShelveTestJSON-512943003 tempest-AttachVolumeShelveTestJSON-512943003-project-member] Enqueued Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_members [ 1235.038634] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 with Priority: HIGHEST for action security_group_members [ 1235.038957] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.039111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.039169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.039381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.039530] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.039623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.039682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.039826] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.039916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.040013] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ed643b7d-1e4e-4399-802c-1e6860cd4cd5',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.068414] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96c24dfa-dab7-474a-b4bc-2b49c584c9f3: rpc.has_security_group_logging(os_id): False [ 1235.086524] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.086728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.086728] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.086972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.087078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.087366] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.087479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.087544] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.087710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.087788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.087885] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 is going to be updated. [ 1235.150816] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.151013] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.151077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.151247] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.151394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.165358] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: IN_PROGRESS for 2s [ 1235.542653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.542921] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.543072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.543309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.543434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.543721] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.543842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.543934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.544185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.544310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.544448] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 is going to be updated. [ 1235.576755] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.577209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.577209] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.577497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.577755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.587712] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: IN_PROGRESS for 2s [ 1236.063316] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-522 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.063522] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.063623] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.063882] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.064167] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.064317] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.064427] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.064634] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.064770] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.065254] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.065254] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.065254] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.065463] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.065463] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.065565] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.065628] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.085040] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.085210] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1236.085341] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.085504] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-522" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.085880] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-0c451b95-baf8-43e9-befe-13a6ea917c5f taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.086081] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.086202] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.086528] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.086661] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c451b95-baf8-43e9-befe-13a6ea917c5f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.589468] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.589811] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.589811] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.590113] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.590264] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.590551] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.590709] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.590825] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.591053] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.591188] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.591464] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.591623] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.591737] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.591939] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.592086] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.592225] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 0c451b95-baf8-43e9-befe-13a6ea917c5f is going to be updated. [ 1236.614346] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.614529] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.614663] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.614961] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.615186] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.615423] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.180049] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: SUCCESS [ 1237.180049] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.332745] env[65106]: INFO networking_nsxv3.common.synchronization [req-94a8eb70-488c-4d91-8364-9df332ef1bb2 req-5e54e053-7030-4b39-bce9-b896ed1c5278 service nova] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 1237.332977] env[65106]: INFO networking_nsxv3.common.synchronization [req-94a8eb70-488c-4d91-8364-9df332ef1bb2 req-5e54e053-7030-4b39-bce9-b896ed1c5278 service nova] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1237.333346] env[65106]: INFO networking_nsxv3.common.synchronization [req-94a8eb70-488c-4d91-8364-9df332ef1bb2 req-5e54e053-7030-4b39-bce9-b896ed1c5278 service nova] Enqueued Resource ID: 0c451b95-baf8-43e9-befe-13a6ea917c5f with Priority: HIGHEST for action port [ 1237.333765] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_rules [ 1237.333923] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1237.334166] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c451b95-baf8-43e9-befe-13a6ea917c5f with Priority: HIGHEST for action port [ 1237.334571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.334779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.335025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.335164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.335329] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.336885] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.336885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.337029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.337258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.337443] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.337559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.337722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.337799] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.337909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.338036] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.341542] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c451b95-baf8-43e9-befe-13a6ea917c5f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.341654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.341721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.341885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.341964] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c451b95-baf8-43e9-befe-13a6ea917c5f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.597575] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 in Status: SUCCESS [ 1237.597898] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ed643b7d-1e4e-4399-802c-1e6860cd4cd5 deletion is rescheduled due to dependency. [ 1237.597898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ed643b7d-1e4e-4399-802c-1e6860cd4cd5" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.692296] env[65106]: INFO networking_nsxv3.common.synchronization [None req-e7bc569c-c82c-4941-a310-ed92177af749 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1237.692921] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1237.693265] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.693394] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.693463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.693667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.693825] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.693943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.694017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.694187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.694286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.694374] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.843327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.844018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.844018] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.846174] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c451b95-baf8-43e9-befe-13a6ea917c5f with status ACTIVE [ 1237.846174] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.846174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.846174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.846174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.846174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.846174] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.846174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.846174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.846174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.846174] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.846174] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.846622] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.846660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.846842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.847084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.847183] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c451b95-baf8-43e9-befe-13a6ea917c5f is going to be updated. [ 1237.869682] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.869838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.869908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.870144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.870283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.870474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c451b95-baf8-43e9-befe-13a6ea917c5f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.201344] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.202130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.202130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.202434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.203851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.203851] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.203851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.203851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.203851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.203851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.203851] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1238.229804] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.231912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.231912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.231912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.231912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.241256] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1238.349916] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.819526] env[65106]: INFO networking_nsxv3.common.synchronization [req-70ea83f3-b7e6-4dd0-9814-23f0a3fdb9c2 req-b7ddd989-50e2-44b7-9c4c-023d8002d8a2 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1238.820105] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1238.820414] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.820542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.820627] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.820825] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.821013] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.821361] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.821442] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.822467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.822467] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.822467] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.854025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.854466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.854606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.854830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.854930] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.855250] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 1238.889314] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.889450] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.889530] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.889733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.889878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.901502] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 1239.149128] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.149352] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.149483] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.149748] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.150014] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.150170] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.150285] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.150492] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.150630] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.150837] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1239.150945] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.151063] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.151170] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.151281] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1239.151383] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.151512] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.172692] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.172898] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1239.173029] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.173190] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-367" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.173516] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.173688] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.173805] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.174164] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.174310] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26de2a51-eb3b-4fdf-bf17-b93b6d85b80b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.324485] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.676685] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.676861] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.676981] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.677411] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.677649] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.677817] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 26de2a51-eb3b-4fdf-bf17-b93b6d85b80b not found, creating... [ 1239.678108] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.678273] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.678404] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.678645] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.678780] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.679085] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.679245] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.679360] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.679604] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.679745] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.679884] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 26de2a51-eb3b-4fdf-bf17-b93b6d85b80b is going to be created. [ 1239.699784] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.700035] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.700175] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.700456] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.700748] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.701060] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.828986] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.252114] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1240.252114] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c deletion is rescheduled due to dependency. [ 1240.252114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.332978] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.333594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.333720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.334402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.334402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.334402] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1240.368913] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.368913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.368913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.368913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.368913] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.389941] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1240.474346] env[65106]: INFO networking_nsxv3.common.synchronization [req-187db692-7eda-4f61-9a8e-9138f5820f8f req-d2660163-6f66-4d7a-ae95-8d9ef49b3ed4 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_members [ 1240.474892] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGHEST for action security_group_members [ 1240.475201] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-32b8a1f4-4418-4fc5-8176-f9ec13d23327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.475323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.475390] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.475590] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.475754] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.475850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.475914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.476084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.476168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.476331] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.827275] env[65106]: INFO networking_nsxv3.common.synchronization [req-70ea83f3-b7e6-4dd0-9814-23f0a3fdb9c2 req-265e5bb2-3d4b-4669-8c27-cf8ad446d7e5 service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1240.827600] env[65106]: INFO networking_nsxv3.common.synchronization [req-70ea83f3-b7e6-4dd0-9814-23f0a3fdb9c2 req-265e5bb2-3d4b-4669-8c27-cf8ad446d7e5 service nova] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1240.827772] env[65106]: INFO networking_nsxv3.common.synchronization [req-70ea83f3-b7e6-4dd0-9814-23f0a3fdb9c2 req-265e5bb2-3d4b-4669-8c27-cf8ad446d7e5 service nova] Enqueued Resource ID: 26de2a51-eb3b-4fdf-bf17-b93b6d85b80b with Priority: HIGHEST for action port [ 1240.828723] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_rules [ 1240.828797] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1240.828884] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26de2a51-eb3b-4fdf-bf17-b93b6d85b80b with Priority: HIGHEST for action port [ 1240.829172] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.829447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.829447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.829707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.829707] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.830764] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.830861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.831066] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.831172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.831220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.831396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.831485] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26de2a51-eb3b-4fdf-bf17-b93b6d85b80b',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.911109] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 1240.911449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.911558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.911884] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.912098] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.912336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.912336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.912478] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.912592] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.912662] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.912762] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.980589] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.980589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.980589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.980589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.980589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.980589] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.980589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.980589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.980589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.980589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.980589] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 is going to be updated. [ 1241.012392] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.012902] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.013133] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.013531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.013772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.023681] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 in Status: IN_PROGRESS for 2s [ 1241.335676] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.335857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.336101] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26de2a51-eb3b-4fdf-bf17-b93b6d85b80b with status ACTIVE [ 1241.336385] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.336566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.336613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.336881] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.337055] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.337267] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.337402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.337583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.337711] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.337810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.338055] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.338221] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.338314] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.338488] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.338599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.338720] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26de2a51-eb3b-4fdf-bf17-b93b6d85b80b is going to be updated. [ 1241.379961] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.379961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.379961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.379961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.379961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.379961] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26de2a51-eb3b-4fdf-bf17-b93b6d85b80b" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.417024] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.921406] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4755538-f7a6-45f7-9a19-37103260244a: rpc.has_security_group_logging(os_id): False [ 1241.942480] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.942756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.942756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.942900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.942989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.943328] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.943470] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.943529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.943691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.943766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.943837] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 1242.014566] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.014761] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.014879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.015204] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.015375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.029192] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 1242.404087] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1242.404518] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.404817] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.405079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.405376] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.405558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.405667] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.405886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.405983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.406103] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.908379] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.033264] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 in Status: SUCCESS [ 1243.033618] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 deletion is rescheduled due to dependency. [ 1243.033618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.411129] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.914617] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.914829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.914892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.915192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.915618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.915618] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1243.950319] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.950319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.950584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.950794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.950995] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.961058] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1244.047961] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 1244.048415] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.573941] env[65106]: INFO networking_nsxv3.common.synchronization [None req-45c91ab1-a83b-46df-adb4-10e27a581568 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_rules [ 1245.574650] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_rules [ 1245.574960] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-134b394e-9f92-403c-9806-46f83c6e11c4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.575278] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.575392] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.575626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.575702] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.720730] env[65106]: INFO networking_nsxv3.common.synchronization [None req-294f2652-92fb-4630-a49d-c864c1459f0c tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_rules [ 1245.720730] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_rules [ 1245.720730] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-134b394e-9f92-403c-9806-46f83c6e11c4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.720730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.971736] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1245.973257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.973257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.973257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.973257] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.973257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.973257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.973257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.973257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.973257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.973257] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.099410] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.099732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.099732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.100045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.100164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.100305] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 134b394e-9f92-403c-9806-46f83c6e11c4 already deleted. [ 1246.100425] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.100665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.100887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.100997] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.479030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.479030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.479030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.479030] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.479030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.479878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.479878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.479878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.479878] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.479878] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.622269] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.622625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.622625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.622717] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.622779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.623241] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 134b394e-9f92-403c-9806-46f83c6e11c4 already deleted. [ 1246.623241] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.982724] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd: rpc.has_security_group_logging(os_id): False [ 1247.005097] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.005316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.005316] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.006053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.007042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.007042] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.007042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.007042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.007042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.007042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.007042] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.007459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.007459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.007459] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.007566] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.007729] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.007780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.007876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.008027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.008111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.008196] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1247.113586] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.113586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.113586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.113586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.113586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.132335] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1249.146028] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1249.146554] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.721438] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1250.721771] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1251.598199] env[65106]: INFO networking_nsxv3.common.synchronization [req-8d3b069e-566f-4e58-a75a-e285fdfa8eea req-244cc142-1c4b-4d51-84a9-440ddf1afc4b tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_members [ 1251.598809] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_members [ 1251.599903] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-134b394e-9f92-403c-9806-46f83c6e11c4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.599903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.599903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.599903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.600271] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.600271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.600377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.600494] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.600584] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.600750] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.924841] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-290 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.924841] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.925245] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.925281] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.925574] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.926195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.926195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.926195] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.926461] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.926648] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.926795] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.926991] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.927134] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.927204] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.927358] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.927564] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.948737] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.948970] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1251.949129] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.949306] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-290" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.949626] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-f9ac7504-d0d9-46e6-9a27-77423c49477f taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.949794] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-f9ac7504-d0d9-46e6-9a27-77423c49477f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.949917] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-f9ac7504-d0d9-46e6-9a27-77423c49477f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.950271] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-f9ac7504-d0d9-46e6-9a27-77423c49477f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.950407] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ac7504-d0d9-46e6-9a27-77423c49477f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.104860] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.104860] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.104860] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134b394e-9f92-403c-9806-46f83c6e11c4 already deleted. [ 1252.104860] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.452982] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.452982] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.452982] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.453445] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.453445] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.453574] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port f9ac7504-d0d9-46e6-9a27-77423c49477f not found, creating... [ 1252.453843] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.454082] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.454220] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.454466] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.454607] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.454893] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.455060] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.455175] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.455382] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.455514] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.455648] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: f9ac7504-d0d9-46e6-9a27-77423c49477f is going to be created. [ 1252.478506] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.478714] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.478811] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.479144] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.479417] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.479692] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-f9ac7504-d0d9-46e6-9a27-77423c49477f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.174167] env[65106]: INFO networking_nsxv3.common.synchronization [req-8d3b069e-566f-4e58-a75a-e285fdfa8eea req-a94c6208-2232-4250-b5aa-0225e0c91c55 service nova] Enqueued Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_rules [ 1253.174643] env[65106]: INFO networking_nsxv3.common.synchronization [req-8d3b069e-566f-4e58-a75a-e285fdfa8eea req-a94c6208-2232-4250-b5aa-0225e0c91c55 service nova] Enqueued Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_members [ 1253.174643] env[65106]: INFO networking_nsxv3.common.synchronization [req-8d3b069e-566f-4e58-a75a-e285fdfa8eea req-a94c6208-2232-4250-b5aa-0225e0c91c55 service nova] Enqueued Resource ID: f9ac7504-d0d9-46e6-9a27-77423c49477f with Priority: HIGHEST for action port [ 1253.175447] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_rules [ 1253.175642] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_members [ 1253.175800] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9ac7504-d0d9-46e6-9a27-77423c49477f with Priority: HIGHEST for action port [ 1253.176203] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-134b394e-9f92-403c-9806-46f83c6e11c4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.176493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.176493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.176767] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.176895] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.178011] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-134b394e-9f92-403c-9806-46f83c6e11c4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.178180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.178285] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.178687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.178905] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.179063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.179905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.180118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.180216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.180317] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.181539] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9ac7504-d0d9-46e6-9a27-77423c49477f taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.181666] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9ac7504-d0d9-46e6-9a27-77423c49477f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.181721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9ac7504-d0d9-46e6-9a27-77423c49477f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.181874] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9ac7504-d0d9-46e6-9a27-77423c49477f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.181966] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9ac7504-d0d9-46e6-9a27-77423c49477f',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.683873] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.685937] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-134b394e-9f92-403c-9806-46f83c6e11c4 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.685937] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.685937] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f9ac7504-d0d9-46e6-9a27-77423c49477f with status ACTIVE [ 1253.686239] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.686239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.686239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.686490] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.686557] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.686716] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.686810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.686872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.687063] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.687151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.687331] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.687443] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.687568] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.687643] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.687718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.687798] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f9ac7504-d0d9-46e6-9a27-77423c49477f is going to be updated. [ 1253.712799] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.713043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.713043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.713236] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.713373] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.713538] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9ac7504-d0d9-46e6-9a27-77423c49477f" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.186470] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.480286] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.480499] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.480891] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.480946] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.481831] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.482146] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.482323] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.482605] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.482765] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.482976] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1254.483100] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1254.483231] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1254.483347] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1254.483460] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1254.483590] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1254.483738] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1254.504854] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1254.505029] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1254.505177] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1254.505351] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.505671] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-04abd655-87a7-4eef-b640-df043fe3af03 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.505845] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.505963] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.506341] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.506520] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04abd655-87a7-4eef-b640-df043fe3af03',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.690034] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.690034] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.690244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.690330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.690385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.690511] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134b394e-9f92-403c-9806-46f83c6e11c4 is going to be created. [ 1254.713397] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.713639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.713639] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.714127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.714127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.723529] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134b394e-9f92-403c-9806-46f83c6e11c4 in Status: UNINITIALIZED for 2s [ 1255.011914] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.012181] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.012317] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.012616] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.012764] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.012917] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 04abd655-87a7-4eef-b640-df043fe3af03 not found, creating... [ 1255.013184] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.013337] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.013466] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.013680] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.013824] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.014226] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.014413] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.014534] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.014762] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.014897] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.015068] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 04abd655-87a7-4eef-b640-df043fe3af03 is going to be created. [ 1255.035363] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.035363] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.035363] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.035698] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.035999] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.036312] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.270575] env[65106]: INFO networking_nsxv3.common.synchronization [req-09fedd11-c270-493d-ba9e-b5cf41c777bf req-afbead47-94a7-417c-b951-8cb1c7b42723 tempest-ServerActionsTestOtherB-878484751 tempest-ServerActionsTestOtherB-878484751-project-member] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1255.271533] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGHEST for action security_group_members [ 1255.271957] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.272235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.272362] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.272625] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.272844] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.272999] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.273121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.273354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.276106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.276106] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.735962] env[65106]: INFO networking_nsxv3.common.synchronization [req-9d3bd21b-2dd0-474d-a1f9-907aa57d3f88 req-2a0302ee-4c2f-4ac7-92f0-cea74e5ad5c8 service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1255.736165] env[65106]: INFO networking_nsxv3.common.synchronization [req-9d3bd21b-2dd0-474d-a1f9-907aa57d3f88 req-2a0302ee-4c2f-4ac7-92f0-cea74e5ad5c8 service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1255.736339] env[65106]: INFO networking_nsxv3.common.synchronization [req-9d3bd21b-2dd0-474d-a1f9-907aa57d3f88 req-2a0302ee-4c2f-4ac7-92f0-cea74e5ad5c8 service nova] Enqueued Resource ID: 04abd655-87a7-4eef-b640-df043fe3af03 with Priority: HIGHEST for action port [ 1255.736920] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1255.737132] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1255.737253] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04abd655-87a7-4eef-b640-df043fe3af03 with Priority: HIGHEST for action port [ 1255.737558] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.737691] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.737748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.737947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.738067] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.738977] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.739137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.739178] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.739322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.739489] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.739593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.739656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.739805] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.739888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.739980] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.740789] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-04abd655-87a7-4eef-b640-df043fe3af03 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.740897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.740897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.741571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.741693] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04abd655-87a7-4eef-b640-df043fe3af03',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.777593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.777780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.777835] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.778122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.778244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.778473] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.778609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.778707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.778903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.779035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.779112] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be updated. [ 1255.806554] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.806739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.806780] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.806978] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.807137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.816318] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: IN_PROGRESS for 2s [ 1256.244062] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.244282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.244520] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.247770] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04abd655-87a7-4eef-b640-df043fe3af03 with status ACTIVE [ 1256.248593] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.248593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.248593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.248593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.248593] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.248950] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.249059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.249111] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.249326] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.249415] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.249642] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.249811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.249811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.249959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.250041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.250094] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04abd655-87a7-4eef-b640-df043fe3af03 is going to be updated. [ 1256.273473] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.273898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.273898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.273898] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.274065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.274169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.672152] env[65106]: INFO networking_nsxv3.common.synchronization [req-45c3e881-d697-400d-8256-bf98b940716a req-477c79be-60f2-40d2-b397-ef354fa3975d tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1256.672653] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1256.672959] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.673099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.673167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.673363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.673521] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.673647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.673714] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.673862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.673945] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.674051] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.734150] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134b394e-9f92-403c-9806-46f83c6e11c4 in Status: SUCCESS [ 1256.734451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.735069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.735069] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.735210] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.735497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.735497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.735497] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.735606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.735606] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.735694] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.751825] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.175925] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.238546] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.253912] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.253912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.253912] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.254193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.254193] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.254256] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1257.286598] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.286987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.286987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.286987] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.287131] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.298405] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1257.678406] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.743078] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 134b394e-9f92-403c-9806-46f83c6e11c4: rpc.has_security_group_logging(os_id): False [ 1257.762664] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.762833] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.762908] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.763121] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.763214] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.763472] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.763578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.763657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.763764] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.763831] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.763919] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 134b394e-9f92-403c-9806-46f83c6e11c4 is going to be created. [ 1257.831867] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.832096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.832096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.832329] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.832476] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.834194] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4755538-f7a6-45f7-9a19-37103260244a in Status: SUCCESS [ 1257.834346] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4755538-f7a6-45f7-9a19-37103260244a deletion is rescheduled due to dependency. [ 1257.834446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.844196] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 134b394e-9f92-403c-9806-46f83c6e11c4 in Status: IN_PROGRESS for 2s [ 1258.181236] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.181487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.181598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.181885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.182041] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.182202] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1258.209702] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.209904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.209904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.210116] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.210271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.218585] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1259.314235] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1259.314565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.314770] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.315127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.315386] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.315556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.315647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.315843] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.315969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.316098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.316217] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.365941] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1259.366141] env[65106]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-81c5f5c6-6722-4c1f-8343-172ef0ab14da None None] NSXv3 Agent Agent loop - iteration:3 started [ 1259.818779] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.818959] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.819040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.819372] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.819608] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.819783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.819887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.820126] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.820260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.820402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.820639] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.820766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.820850] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.821043] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.821218] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.821323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.821413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.821556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.821647] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.821733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.821840] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.858776] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 134b394e-9f92-403c-9806-46f83c6e11c4 in Status: SUCCESS [ 1259.859052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.231284] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1260.231534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.324657] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8659458-b39f-4232-9cb7-76bba1a9081c: rpc.has_security_group_logging(os_id): False [ 1260.344521] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.344762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.344762] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.345074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.345172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.345504] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.345748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.345838] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.346081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.346162] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.347431] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.347431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.347431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.347431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.347431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.347431] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.347431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.347431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.347431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.347431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.347431] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1260.428022] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.428279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.428279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.428437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.428583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.453235] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1261.673513] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.673830] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1262.468181] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1262.468402] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.193719] env[65106]: INFO networking_nsxv3.common.synchronization [req-d8ce3998-48c6-4ad7-9336-13c70f74cd9c req-99b8092e-acad-478d-aec8-b974fc470e17 tempest-ServersTestJSON-1868561035 tempest-ServersTestJSON-1868561035-project-member] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1265.194586] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGHEST for action security_group_members [ 1265.194686] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.194807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.194840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.195137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.195338] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.195424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.195486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.195642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.195732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.195823] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.330179] env[65106]: INFO networking_nsxv3.common.synchronization [req-18617db9-93b0-4c3f-8007-6a6228815b7f req-08a7c94f-1d2c-4479-a882-d9eaf3ff3ae6 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1265.330778] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1265.331171] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.331300] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.331379] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.331607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.331842] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.331942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.332062] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.332217] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.332349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.332569] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.698119] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.698289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.698386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.698587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.698677] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.698873] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.698989] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.699037] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.699187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.699262] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.699358] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be updated. [ 1265.731154] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.731154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.731154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.731154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.731154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.740353] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: IN_PROGRESS for 2s [ 1265.836690] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.837328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.837418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.837633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.837730] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.837958] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.838061] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.838120] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.838277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.838354] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.838439] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1265.869955] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.870153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.870238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.870486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.870559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.880806] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1267.750705] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd in Status: SUCCESS [ 1267.751079] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd deletion is rescheduled due to dependency. [ 1267.751079] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.890719] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1267.890915] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 deletion is rescheduled due to dependency. [ 1267.891019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.318115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.318360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.318407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.318632] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.318765] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.821492] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.323827] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.826855] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1269.827140] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1270.332704] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.333753] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1270.620355] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.620511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.620583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.620827] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.632848] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1270.633782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.635232] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1270.677416] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.677670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.677670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.677872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.691941] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.692811] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1270.692897] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1270.692990] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1270.738511] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.738676] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.738748] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.739014] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.740487] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.740670] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1270.835737] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.835737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.835737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.835737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.835737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.836227] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1270.916194] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.916393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.916393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.916839] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.917009] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.917319] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:50. [ 1270.917417] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'18c5de97-57c7-4a3b-bcac-83d49995e933', '4451dd0e-c25c-4af6-bb10-62fc99478e20', '4372f393-06e7-4930-9ab6-1687d050de71', 'd8659458-b39f-4232-9cb7-76bba1a9081c', 'aef9a0c3-8949-42e0-b152-6d0e475589ef', '68b6b1dd-52ab-4ef3-8749-07f0a0035702', '9afb3113-d995-4d39-b176-5a19c6a11e2c', 'b4755538-f7a6-45f7-9a19-37103260244a', '7a5ed45f-6939-497b-9937-079be854fa2e', 'a2cf4d8d-838b-4bef-8391-fb65a3ba9c75', '63b6ebcd-ce8d-4da7-b33a-c7bd45edb898', 'f20d6572-0b4b-48a0-8c23-2a251368deef', '32b8a1f4-4418-4fc5-8176-f9ec13d23327', '9c074b17-b18d-425c-b595-ed5504aae380', '00fc8ecc-2b12-478d-8a50-43a7183605bc', '1f020ee1-e888-4331-aa52-96bec4612d2e', '611ce8e9-468b-46ff-b93b-ebf52e6cce82', '96c24dfa-dab7-474a-b4bc-2b49c584c9f3', '2ac39219-abfa-4fe5-9c06-ff6077c1cbbd', '80c55b4c-229d-4278-a249-6eb0843ce4fd', 'a791c8c3-0f7e-4205-8d3d-977dc22a4708', 'ed643b7d-1e4e-4399-802c-1e6860cd4cd5', '5b77c3b5-bcbc-4373-ba6a-5877c470d364', '2a2be5f5-efc1-4508-8ee3-6d684d4520ca', '1c844632-55aa-48db-8ca5-f00fe2244035', 'ac9de4d4-ec9d-4ad4-ad6f-65eee9862501', '5e524fc2-f045-49dd-9b9d-694845e21af8', '7ea85039-86ee-4308-91e9-eb31b591a98a', 'b4453797-05cb-4758-bad7-725b4ea09d52', '8062a050-fddc-4392-b032-558be3ae0629', '2e246f09-3adc-4e5b-92ef-400b3e3d4ada', 'b922414d-be26-4348-b82b-5fd8d10033d4', 'f58b21a0-a1cb-4daa-9136-8c66dc9641d3', 'bfd09ac0-101c-4f4a-a6a9-9a67108ff64a', '49f44a93-5686-4d9d-984b-4efb2550596c', 'faa319fa-2be7-45e6-acc2-0f5f031e93fb', 'b3689440-fdf4-4f9a-8a43-00a54e71ca10', 'f8e3138f-71fe-44de-b062-382436a9dc63', '0f36e318-4a87-4b4f-9bd9-1b549e42f93c', '339605f7-09cd-456f-a3a0-4495fb59f075', '2780c3aa-d7c0-4b04-ab51-f490d784ede7', '4dcae410-a891-453e-bd43-6b1770f373d3', 'c3af0f50-d3c0-4cec-9e7d-9ddf50cb9af9', 'ff5ba0af-d21f-4f03-b95d-0c41f57292b6', '01b4eb11-03ce-4bd8-b79e-203c6ae9c9ff', '820bfc9e-ba46-4ec6-a32e-76e00c539d2e', '143c4b09-e4ef-4609-8ff0-863f1dce9402', '801f4d67-386f-4801-8f6a-7817c5da92ef', '4202ae94-9151-4db6-b1be-f69fcc7dc349', '134b394e-9f92-403c-9806-46f83c6e11c4'} {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1270.917518] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1270.936449] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.936749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.936861] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.937118] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.937212] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.937332] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1270.937439] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1270.937544] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1271.019203] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.019650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.019650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.019872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.020905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.021225] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1271.021305] env[65106]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65106) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1271.021379] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1271.021448] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1271.021527] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/50 resources of Type:Security Group Rules [ 1271.021598] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGH for action security_group_rules [ 1271.021676] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGH for action security_group_rules [ 1271.021748] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGH for action security_group_rules [ 1271.021850] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGH for action security_group_rules [ 1271.021951] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGH for action security_group_rules [ 1271.022063] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGH for action security_group_rules [ 1271.022504] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGH for action security_group_rules [ 1271.022504] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGH for action security_group_rules [ 1271.022504] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGH for action security_group_rules [ 1271.022504] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGH for action security_group_rules [ 1271.022666] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGH for action security_group_rules [ 1271.022666] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGH for action security_group_rules [ 1271.022761] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGH for action security_group_rules [ 1271.022866] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGH for action security_group_rules [ 1271.022978] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGH for action security_group_rules [ 1271.023125] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGH for action security_group_rules [ 1271.023239] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGH for action security_group_rules [ 1271.023355] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGH for action security_group_rules [ 1271.023469] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGH for action security_group_rules [ 1271.023560] env[65106]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGH for action security_group_rules [ 1271.023682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.759970] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.760188] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.760310] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.760562] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.760816] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.760971] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.761095] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.761298] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.761434] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.761640] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.761746] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1271.761846] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1271.761946] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1271.762089] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1271.762202] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1271.762332] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1271.780056] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1271.780188] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1271.780324] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1271.780491] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-706" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.780805] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-04abd655-87a7-4eef-b640-df043fe3af03 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.780973] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.781103] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.781359] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.781492] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04abd655-87a7-4eef-b640-df043fe3af03',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.283676] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.284088] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.284088] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.284322] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.285135] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.285135] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.285135] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.285135] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.285470] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.285470] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.285854] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.285957] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.286059] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.286329] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.286433] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.286686] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 04abd655-87a7-4eef-b640-df043fe3af03 is going to be updated. [ 1272.308105] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.308324] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.308324] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.308591] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.308869] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.309127] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.014699] env[65106]: INFO networking_nsxv3.common.synchronization [req-9d3a77f3-17ca-4eff-9805-7e73823ca736 req-4a34a1b8-45b5-4556-8486-9d84e51759c9 service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1273.014938] env[65106]: INFO networking_nsxv3.common.synchronization [req-9d3a77f3-17ca-4eff-9805-7e73823ca736 req-4a34a1b8-45b5-4556-8486-9d84e51759c9 service nova] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1273.015120] env[65106]: INFO networking_nsxv3.common.synchronization [req-9d3a77f3-17ca-4eff-9805-7e73823ca736 req-4a34a1b8-45b5-4556-8486-9d84e51759c9 service nova] Enqueued Resource ID: 04abd655-87a7-4eef-b640-df043fe3af03 with Priority: HIGHEST for action port [ 1273.015978] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_rules [ 1273.016158] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1273.016286] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04abd655-87a7-4eef-b640-df043fe3af03 with Priority: HIGHEST for action port [ 1273.016391] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGH for action security_group_rules [ 1273.016534] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f393-06e7-4930-9ab6-1687d050de71 with Priority: HIGH for action security_group_rules [ 1273.016653] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c with Priority: HIGH for action security_group_rules [ 1273.016756] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc with Priority: HIGH for action security_group_rules [ 1273.016849] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd with Priority: HIGH for action security_group_rules [ 1273.016940] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd with Priority: HIGH for action security_group_rules [ 1273.017044] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGH for action security_group_rules [ 1273.017225] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 with Priority: HIGH for action security_group_rules [ 1273.017356] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c074b17-b18d-425c-b595-ed5504aae380 with Priority: HIGH for action security_group_rules [ 1273.017459] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f020ee1-e888-4331-aa52-96bec4612d2e with Priority: HIGH for action security_group_rules [ 1273.017592] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 with Priority: HIGH for action security_group_rules [ 1273.017960] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f20d6572-0b4b-48a0-8c23-2a251368deef with Priority: HIGH for action security_group_rules [ 1273.018135] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 with Priority: HIGH for action security_group_rules [ 1273.018262] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 with Priority: HIGH for action security_group_rules [ 1273.018322] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a5ed45f-6939-497b-9937-079be854fa2e with Priority: HIGH for action security_group_rules [ 1273.018430] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 with Priority: HIGH for action security_group_rules [ 1273.018569] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4755538-f7a6-45f7-9a19-37103260244a with Priority: HIGH for action security_group_rules [ 1273.018688] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aef9a0c3-8949-42e0-b152-6d0e475589ef with Priority: HIGH for action security_group_rules [ 1273.018815] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 with Priority: HIGH for action security_group_rules [ 1273.018917] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGH for action security_group_rules [ 1273.019241] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.019365] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.019421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.019633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.019715] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.020687] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.020832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.020905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.021142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.021303] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.021418] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.021499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.021681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.021783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.021885] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.023045] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-04abd655-87a7-4eef-b640-df043fe3af03 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.023183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.023267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.023439] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.023520] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04abd655-87a7-4eef-b640-df043fe3af03',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.024450] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.024607] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.024684] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.024889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.024971] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.025809] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4372f393-06e7-4930-9ab6-1687d050de71 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.025953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.026052] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.026261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.026345] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4372f393-06e7-4930-9ab6-1687d050de71',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.027189] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9afb3113-d995-4d39-b176-5a19c6a11e2c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.027309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.027378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.027559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.027669] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9afb3113-d995-4d39-b176-5a19c6a11e2c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.028601] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00fc8ecc-2b12-478d-8a50-43a7183605bc taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.028715] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.028793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.028992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.029103] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00fc8ecc-2b12-478d-8a50-43a7183605bc',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.029832] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-80c55b4c-229d-4278-a249-6eb0843ce4fd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.029943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.030038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.030169] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.030243] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('80c55b4c-229d-4278-a249-6eb0843ce4fd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.030918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.031035] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.031106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.031257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.031332] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ac39219-abfa-4fe5-9c06-ff6077c1cbbd',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.032012] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.032135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.032207] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.032359] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.032435] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.033245] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.033367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.033437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.033589] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.033666] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('611ce8e9-468b-46ff-b93b-ebf52e6cce82',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.034407] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c074b17-b18d-425c-b595-ed5504aae380 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.034556] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.034623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.034824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.034899] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c074b17-b18d-425c-b595-ed5504aae380',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.035678] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1f020ee1-e888-4331-aa52-96bec4612d2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.035793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.035862] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.036025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.036104] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1f020ee1-e888-4331-aa52-96bec4612d2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.037168] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.037277] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.037345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.037499] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.037572] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32b8a1f4-4418-4fc5-8176-f9ec13d23327',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.038256] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f20d6572-0b4b-48a0-8c23-2a251368deef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.038366] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.038434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.038583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.038658] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f20d6572-0b4b-48a0-8c23-2a251368deef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.039376] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.039535] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.039604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.039778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.039888] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('63b6ebcd-ce8d-4da7-b33a-c7bd45edb898',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.040644] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.040755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.040824] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.040972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.041060] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a2cf4d8d-838b-4bef-8391-fb65a3ba9c75',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.041731] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a5ed45f-6939-497b-9937-079be854fa2e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.041840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.041934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.042064] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.042139] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a5ed45f-6939-497b-9937-079be854fa2e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.042807] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.042915] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.042982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.043150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.043225] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('68b6b1dd-52ab-4ef3-8749-07f0a0035702',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.043992] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4755538-f7a6-45f7-9a19-37103260244a taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.044114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.044181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.044357] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.044456] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4755538-f7a6-45f7-9a19-37103260244a',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.045252] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aef9a0c3-8949-42e0-b152-6d0e475589ef taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.045360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.045427] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.045946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.046043] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aef9a0c3-8949-42e0-b152-6d0e475589ef',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.046759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4451dd0e-c25c-4af6-bb10-62fc99478e20 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.046870] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.046939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.047127] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.047204] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4451dd0e-c25c-4af6-bb10-62fc99478e20',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.048448] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.048551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.052259] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.550675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.550982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.555894] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.556030] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.556104] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.556303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.556460] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.556582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.556648] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.556801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.556886] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.556969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.557067] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.563577] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04abd655-87a7-4eef-b640-df043fe3af03 with status ACTIVE [ 1273.563781] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.563911] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.563980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.564153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.564250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.564418] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.564512] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.564587] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.564737] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.564812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.565083] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.565166] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.565822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.565822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.565822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.565822] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04abd655-87a7-4eef-b640-df043fe3af03 is going to be updated. [ 1273.568086] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.568211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.568266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.568403] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.568545] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.568638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.568695] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.568829] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.568903] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.568980] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.569076] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.582961] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.621327] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.621531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.621531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.621674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.623315] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.623433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.624228] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.624323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.625044] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.625142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.625831] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.625926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.627273] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.627396] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.633594] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.633792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.635477] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.635588] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.636701] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.636809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.637556] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.637664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.638399] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.638526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.639183] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.639625] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.639740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.640405] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.640806] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.640942] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.641797] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.642194] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.642342] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.642936] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.643236] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.643347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.643881] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.644266] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.644355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.644987] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.645375] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.645504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.645573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.645803] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.645965] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.646145] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04abd655-87a7-4eef-b640-df043fe3af03" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.646843] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1273.647259] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.647388] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00fc8ecc-2b12-478d-8a50-43a7183605bc is going to be deleted. [ 1273.648831] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.648925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.648982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.649177] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.667015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.667164] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a2cf4d8d-838b-4bef-8391-fb65a3ba9c75 is going to be deleted. [ 1273.667977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.668206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.690199] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.690359] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f20d6572-0b4b-48a0-8c23-2a251368deef is going to be deleted. [ 1273.691338] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.691540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.716774] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.716951] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 80c55b4c-229d-4278-a249-6eb0843ce4fd is going to be deleted. [ 1273.717928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.718161] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.719618] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.719746] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.737377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.737554] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a5ed45f-6939-497b-9937-079be854fa2e is going to be deleted. [ 1273.738397] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.738616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.751522] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.751689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.758147] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.758291] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.759623] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.759739] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32b8a1f4-4418-4fc5-8176-f9ec13d23327 is going to be deleted. [ 1273.760583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.760848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.789821] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.790051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.804729] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.804908] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aef9a0c3-8949-42e0-b152-6d0e475589ef is going to be deleted. [ 1273.805807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.806044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.862579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.862750] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ac39219-abfa-4fe5-9c06-ff6077c1cbbd is going to be deleted. [ 1273.863745] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.864026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.886191] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.886416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.915267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.915478] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4451dd0e-c25c-4af6-bb10-62fc99478e20 is going to be deleted. [ 1273.916414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.916877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.943186] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.943371] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.993561] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.993765] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.994975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.995105] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 63b6ebcd-ce8d-4da7-b33a-c7bd45edb898 is going to be deleted. [ 1273.996029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.996282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.037198] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.037409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.073074] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.073074] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.073875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.073997] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4755538-f7a6-45f7-9a19-37103260244a is going to be deleted. [ 1274.074956] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.075190] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.076064] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.079509] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.089322] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.089524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.089524] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.089735] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.089872] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.089987] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1274.132804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.132979] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4372f393-06e7-4930-9ab6-1687d050de71 is going to be deleted. [ 1274.134033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.134224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.156537] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.156786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.187759] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.188027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.188081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.188312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.188514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.200813] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1274.201789] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.201919] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 68b6b1dd-52ab-4ef3-8749-07f0a0035702 is going to be deleted. [ 1274.202875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.203213] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.205131] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.205303] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.256296] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.256471] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1f020ee1-e888-4331-aa52-96bec4612d2e is going to be deleted. [ 1274.257465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.257687] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.276883] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.277088] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.309840] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.309989] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9afb3113-d995-4d39-b176-5a19c6a11e2c is going to be deleted. [ 1274.310944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.311192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.367815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.367992] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c074b17-b18d-425c-b595-ed5504aae380 is going to be deleted. [ 1274.368944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.369216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.381543] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.381664] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.400025] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.400172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.410019] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.410195] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 611ce8e9-468b-46ff-b93b-ebf52e6cce82 is going to be deleted. [ 1274.411151] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.411376] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.411510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.411703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00fc8ecc-2b12-478d-8a50-43a7183605bc" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.411821] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.411998] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.412091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.412206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a2cf4d8d-838b-4bef-8391-fb65a3ba9c75" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.412779] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.412968] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.413084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.413203] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f20d6572-0b4b-48a0-8c23-2a251368deef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.413469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.413469] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.413573] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.413655] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-80c55b4c-229d-4278-a249-6eb0843ce4fd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.413782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.413922] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.413996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.414153] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a5ed45f-6939-497b-9937-079be854fa2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.414242] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.414387] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.414466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.414656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32b8a1f4-4418-4fc5-8176-f9ec13d23327" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.414801] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.415025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.415025] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.415143] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aef9a0c3-8949-42e0-b152-6d0e475589ef" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.415288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.415435] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.415528] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.415650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ac39219-abfa-4fe5-9c06-ff6077c1cbbd" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.415778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.415918] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.415992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.416115] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4451dd0e-c25c-4af6-bb10-62fc99478e20" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.416238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.416375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.416447] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.416612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-63b6ebcd-ce8d-4da7-b33a-c7bd45edb898" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.416739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.416875] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.416948] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.417073] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4755538-f7a6-45f7-9a19-37103260244a" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.417197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.417334] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.417395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.417513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4372f393-06e7-4930-9ab6-1687d050de71" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.417644] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.417777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.417848] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.417957] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-68b6b1dd-52ab-4ef3-8749-07f0a0035702" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.418096] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.418231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.418302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.418409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1f020ee1-e888-4331-aa52-96bec4612d2e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.455818] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.455986] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.456044] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.456321] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.456424] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.456582] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9afb3113-d995-4d39-b176-5a19c6a11e2c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.490119] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.490274] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.490348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.490575] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.490673] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.490797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c074b17-b18d-425c-b595-ed5504aae380" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.557273] env[65106]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1274.558131] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.558454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.558498] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.558820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.559032] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.559272] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-611ce8e9-468b-46ff-b93b-ebf52e6cce82" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.578847] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 18c5de97-57c7-4a3b-bcac-83d49995e933: rpc.has_security_group_logging(os_id): False [ 1274.582737] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96c24dfa-dab7-474a-b4bc-2b49c584c9f3: rpc.has_security_group_logging(os_id): False [ 1274.597623] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.597796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.597842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.598060] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.599752] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.599871] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.633050] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.633171] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.633279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.633279] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.633461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.633532] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.633618] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 is going to be updated. [ 1274.634756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.634944] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.690952] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.691447] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.691657] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.691796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.692134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.692286] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.692447] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 is going to be updated. [ 1274.732913] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.733185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.733266] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.733456] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.733619] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.746017] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 in Status: IN_PROGRESS for 2s [ 1274.773919] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.774176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.774176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.774343] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.774536] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.787570] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: IN_PROGRESS for 2s [ 1276.211013] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1276.211356] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.211507] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.211834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.212129] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.212295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.212399] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.212654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.212782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.212931] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.213090] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.484717] env[65106]: INFO networking_nsxv3.common.synchronization [req-fadbc389-ed65-4702-a1c3-af3172afab11 req-ae1e59b8-864f-4d14-84c7-97dfee2d1750 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1276.485643] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1276.486157] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.486312] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.486421] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.486756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.486900] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.487091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.487173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.487348] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.487474] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.487591] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.715459] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.715672] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.715722] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.716154] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.716234] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.716297] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.716364] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.716696] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.716857] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.716997] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.717216] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.717363] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.717453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.717768] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.717864] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.717983] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.718078] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.718253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.718349] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.718453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.718552] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.759935] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 in Status: SUCCESS [ 1276.760238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.798699] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: SUCCESS [ 1276.798928] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.837056] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.837056] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.837311] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.837563] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.837915] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.838194] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.838357] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.838636] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.838833] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.839167] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1276.839338] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1276.839496] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1276.839653] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1276.839816] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1276.839968] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1276.840171] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1276.860143] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1276.860311] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1276.860448] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1276.860622] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-835" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.860936] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.861118] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.861238] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.861548] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.861686] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('435e9b88-0ec4-4c45-b135-c6e07d57f9f1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.989571] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.989815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.989889] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.990206] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.012834] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.013194] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.013355] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.013463] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.013775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.013865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.013980] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1277.040302] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.040526] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.040654] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.041137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.041137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.050323] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1277.221017] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8659458-b39f-4232-9cb7-76bba1a9081c: rpc.has_security_group_logging(os_id): False [ 1277.238554] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.238758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.238758] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.239033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.258023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.258299] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.258423] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.258486] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.258685] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.258766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.258990] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.259102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.259180] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.259378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.259458] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.259672] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.259747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.259792] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.259932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.260017] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.260104] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1277.335614] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.335771] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.335814] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.336018] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.336172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.358024] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1277.364157] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.364414] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.364565] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.364878] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.365058] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.365230] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 435e9b88-0ec4-4c45-b135-c6e07d57f9f1 not found, creating... [ 1277.365517] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.365719] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.365844] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.366091] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.366310] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.366565] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.366724] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.366856] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.367079] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.367230] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.367381] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 435e9b88-0ec4-4c45-b135-c6e07d57f9f1 is going to be created. [ 1277.392455] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.392756] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.393152] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.393995] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.394337] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.395311] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.093939] env[65106]: INFO networking_nsxv3.common.synchronization [req-fadbc389-ed65-4702-a1c3-af3172afab11 req-784a9d68-485e-4428-bfc1-36f6acb0cdd6 service nova] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 1278.094135] env[65106]: INFO networking_nsxv3.common.synchronization [req-fadbc389-ed65-4702-a1c3-af3172afab11 req-784a9d68-485e-4428-bfc1-36f6acb0cdd6 service nova] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1278.094270] env[65106]: INFO networking_nsxv3.common.synchronization [req-fadbc389-ed65-4702-a1c3-af3172afab11 req-784a9d68-485e-4428-bfc1-36f6acb0cdd6 service nova] Enqueued Resource ID: 435e9b88-0ec4-4c45-b135-c6e07d57f9f1 with Priority: HIGHEST for action port [ 1278.094535] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_rules [ 1278.094706] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1278.094808] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 435e9b88-0ec4-4c45-b135-c6e07d57f9f1 with Priority: HIGHEST for action port [ 1278.095427] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.095503] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.095567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.095798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.095851] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.096707] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.096807] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.096961] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.097099] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.097137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.097289] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.097362] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('435e9b88-0ec4-4c45-b135-c6e07d57f9f1',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1278.598842] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.598842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.599227] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 435e9b88-0ec4-4c45-b135-c6e07d57f9f1 with status ACTIVE [ 1278.599227] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.599322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.599358] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.599621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.599738] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.599918] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.600027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.600084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.600238] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.600313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.600490] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.600583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.600643] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.600781] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.600851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.600932] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 435e9b88-0ec4-4c45-b135-c6e07d57f9f1 is going to be updated. [ 1278.623556] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.623785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.623785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.623970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.624122] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.624273] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-435e9b88-0ec4-4c45-b135-c6e07d57f9f1" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.061140] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1279.061346] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 deletion is rescheduled due to dependency. [ 1279.061475] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.061603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.061822] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.061999] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.062128] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.062185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.062332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.062413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.062529] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.373039] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1279.373270] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.373451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.373688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.373785] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.565407] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.876487] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.876819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.876819] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.877067] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.877161] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.877281] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.877345] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.877502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.877610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.877705] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.877853] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.067754] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.380547] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.380749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.380791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.381094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.381224] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.381328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.381393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.381546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.381633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.381723] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.381868] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.381958] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.382031] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.382173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.382306] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.382400] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.382515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.382585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.382660] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.382739] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.382827] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.571733] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.571962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.571962] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.572216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.572292] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.572394] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1280.607276] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.607511] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.607608] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.608023] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.608173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.618641] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1280.885408] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8659458-b39f-4232-9cb7-76bba1a9081c: rpc.has_security_group_logging(os_id): False [ 1280.904247] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.904455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.904455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.904732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.904841] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.905059] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.905164] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.905228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.905380] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.905455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.905673] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.905783] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.905858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.905984] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.906068] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.906255] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.906410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.906410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.906531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.906621] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.906709] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1280.970033] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.970301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.970375] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.970613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.970791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.984203] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1282.629253] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1282.629600] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.629656] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.629832] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.630455] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.630455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.630455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.630455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.630455] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.630916] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.630916] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.000297] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1283.000541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.095792] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1283.095992] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1283.133489] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1283.635972] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f8e3138f-71fe-44de-b062-382436a9dc63: rpc.has_security_group_logging(os_id): False [ 1283.657926] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.658155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.658155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.658352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.658451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.658696] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.658798] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.658864] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.659038] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.659147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.659203] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1283.764196] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.764416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.764416] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.764633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.764858] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.786445] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1285.800565] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1285.800905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.097321] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1288.097321] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1288.744900] env[65106]: INFO networking_nsxv3.common.synchronization [req-215e6596-6f03-4dbc-b8e0-6fd0be6b7d5d req-2c1fe863-91b4-44d8-94c7-671a4ec4950f tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1288.745471] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1288.746511] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.746897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.746897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.747051] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.747091] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.747202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.747271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.747410] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.747529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.747585] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.250347] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.755607] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1290.258220] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.258598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.258598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.258682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.258868] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.258868] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 is going to be updated. [ 1290.287896] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1290.288094] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1290.288182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1290.288407] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1290.288574] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1290.297723] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: IN_PROGRESS for 2s [ 1292.308876] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: SUCCESS [ 1292.309309] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.747104] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.747383] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1295.557116] env[65106]: INFO networking_nsxv3.common.synchronization [req-e81b0b84-8531-4478-acde-467623eaf200 req-08df963b-2ecf-489d-b294-098729f079b9 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1295.557504] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 with Priority: HIGHEST for action security_group_members [ 1295.558134] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.558134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.558134] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.558591] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.558591] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.558710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.558710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.559040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.559040] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.559207] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96c24dfa-dab7-474a-b4bc-2b49c584c9f3',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.062517] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.062741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.062741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.063091] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.063184] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.063432] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.063563] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.063650] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.063844] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.063947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.064090] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 is going to be updated. [ 1296.091887] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.092042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.092117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.092381] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.092618] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.104029] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: IN_PROGRESS for 2s [ 1298.117321] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 in Status: SUCCESS [ 1298.117731] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96c24dfa-dab7-474a-b4bc-2b49c584c9f3 deletion is rescheduled due to dependency. [ 1298.117731] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96c24dfa-dab7-474a-b4bc-2b49c584c9f3" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.552867] env[65106]: INFO networking_nsxv3.common.synchronization [None req-482b3259-215f-4bad-94e4-e67deb73e8b9 tempest-AttachInterfacesTestJSON-651328925 tempest-AttachInterfacesTestJSON-651328925-project-member] Enqueued Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1299.553414] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8659458-b39f-4232-9cb7-76bba1a9081c with Priority: HIGHEST for action security_group_members [ 1299.554033] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8659458-b39f-4232-9cb7-76bba1a9081c taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.554033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.554033] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.554240] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.554341] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.554449] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.554513] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.554689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.555081] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.555081] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8659458-b39f-4232-9cb7-76bba1a9081c',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1300.057512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.057712] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.057811] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.058059] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.058192] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.058404] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.058531] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.058595] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.058752] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.058830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.058927] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c is going to be updated. [ 1300.085527] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.085703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.085749] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.085981] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.086163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.095286] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: IN_PROGRESS for 2s [ 1302.108632] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8659458-b39f-4232-9cb7-76bba1a9081c in Status: SUCCESS [ 1302.108969] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8659458-b39f-4232-9cb7-76bba1a9081c deletion is rescheduled due to dependency. [ 1302.108969] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8659458-b39f-4232-9cb7-76bba1a9081c" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.828200] env[65106]: INFO networking_nsxv3.common.synchronization [None req-d2ddf956-c5b8-41dc-9604-c7befecb57cc None None] Enqueued Resource ID: 3fa14294-925d-4321-95bd-0a94c384f650 with Priority: HIGHEST for action port [ 1303.828819] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fa14294-925d-4321-95bd-0a94c384f650 with Priority: HIGHEST for action port [ 1303.829148] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fa14294-925d-4321-95bd-0a94c384f650 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.829269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fa14294-925d-4321-95bd-0a94c384f650" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.829337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fa14294-925d-4321-95bd-0a94c384f650" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.829766] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fa14294-925d-4321-95bd-0a94c384f650" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.829766] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fa14294-925d-4321-95bd-0a94c384f650',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.331732] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3fa14294-925d-4321-95bd-0a94c384f650 [ 1304.332176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.332882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.332882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.332882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.332882] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.333185] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3fa14294-925d-4321-95bd-0a94c384f650 already deleted. [ 1304.333185] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fa14294-925d-4321-95bd-0a94c384f650" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.630571] env[65106]: INFO networking_nsxv3.common.synchronization [None req-cfd927b8-5b21-412e-8055-708e2a9fd962 None None] Enqueued Resource ID: 54cc4c1a-4965-4a3f-93e2-f02f86222775 with Priority: HIGHEST for action port [ 1305.631139] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54cc4c1a-4965-4a3f-93e2-f02f86222775 with Priority: HIGHEST for action port [ 1305.631574] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-54cc4c1a-4965-4a3f-93e2-f02f86222775 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.631756] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54cc4c1a-4965-4a3f-93e2-f02f86222775" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.631830] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54cc4c1a-4965-4a3f-93e2-f02f86222775" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.632167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54cc4c1a-4965-4a3f-93e2-f02f86222775" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.632330] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54cc4c1a-4965-4a3f-93e2-f02f86222775',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.134980] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54cc4c1a-4965-4a3f-93e2-f02f86222775 [ 1306.135115] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.135187] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.135228] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.135534] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.135642] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.135909] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54cc4c1a-4965-4a3f-93e2-f02f86222775 already deleted. [ 1306.135909] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54cc4c1a-4965-4a3f-93e2-f02f86222775" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.134100] env[65106]: INFO networking_nsxv3.common.synchronization [req-7227dcfb-647f-4f3c-835d-93d41a5a7274 req-e2478de7-bc2f-44e4-92d0-63a55a1cd61b tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_members [ 1307.134628] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 with Priority: HIGHEST for action security_group_members [ 1307.134966] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-18c5de97-57c7-4a3b-bcac-83d49995e933 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.135146] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.135235] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.135496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.135677] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.135809] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.135893] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.136117] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.136220] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.136318] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('18c5de97-57c7-4a3b-bcac-83d49995e933',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.638344] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.638542] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.638585] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.638982] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.639168] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.639406] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.639539] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.639604] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.639794] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.639897] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.640032] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 is going to be updated. [ 1307.668142] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.668346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.668346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.668603] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.668772] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.677057] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 in Status: IN_PROGRESS for 2s [ 1309.014067] env[65106]: INFO networking_nsxv3.common.synchronization [req-0105930b-993a-4026-8158-e8bdc78e11ce req-de9ea525-3606-41ee-a436-95dcb0ac641f tempest-InstanceActionsNegativeTestJSON-1410238911 tempest-InstanceActionsNegativeTestJSON-1410238911-project-member] Enqueued Resource ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e with Priority: HIGHEST for action security_group_members [ 1309.014621] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e with Priority: HIGHEST for action security_group_members [ 1309.014952] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.015176] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.015288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.015594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.015810] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.015963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.016080] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.016288] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.016432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.016581] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.295292] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock network-65 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.295292] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "network-65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.295439] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "network-65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.295646] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "network-65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.295903] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.296090] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.296257] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.296423] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.296561] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.296798] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1309.296924] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1309.297045] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1309.297156] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1309.297265] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1309.297368] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1309.297498] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1309.316314] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1309.316512] env[65106]: DEBUG dogpile.cache.region [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1309.316685] env[65106]: DEBUG dogpile.lock [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1309.316929] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "network-65" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.317319] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock port-7f27d027-955d-497f-8253-de95b1cef83e taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.317529] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "port-7f27d027-955d-497f-8253-de95b1cef83e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.317682] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "port-7f27d027-955d-497f-8253-de95b1cef83e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.318069] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "port-7f27d027-955d-497f-8253-de95b1cef83e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.318268] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f27d027-955d-497f-8253-de95b1cef83e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.519116] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.519295] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.519367] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.519583] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.519670] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.519866] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.519970] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.520046] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.520186] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.520261] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.520345] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e already deleted. [ 1309.520426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.687155] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 in Status: SUCCESS [ 1309.687347] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 18c5de97-57c7-4a3b-bcac-83d49995e933 deletion is rescheduled due to dependency. [ 1309.687465] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-18c5de97-57c7-4a3b-bcac-83d49995e933" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.821680] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.821894] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.821894] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.822244] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.822407] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.822570] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Segment Port 7f27d027-955d-497f-8253-de95b1cef83e not found, creating... [ 1309.822908] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.823132] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.823264] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.823491] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.823626] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.823979] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.824169] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.824310] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.824559] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.824755] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.824920] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Resource: SegmentPort with ID: 7f27d027-955d-497f-8253-de95b1cef83e is going to be created. [ 1309.844144] env[65106]: DEBUG networking_nsxv3.common.locking [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.844344] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.844488] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.844779] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.845015] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.845244] env[65106]: DEBUG oslo_concurrency.lockutils [None req-a3efd3c4-7115-41bd-9a4a-e92eb566e18b None None] Releasing lock "port-7f27d027-955d-497f-8253-de95b1cef83e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.546364] env[65106]: INFO networking_nsxv3.common.synchronization [req-0105930b-993a-4026-8158-e8bdc78e11ce req-bfd04313-93fc-45a0-87bf-d2005169546f service nova] Enqueued Resource ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e with Priority: HIGHEST for action security_group_rules [ 1310.546631] env[65106]: INFO networking_nsxv3.common.synchronization [req-0105930b-993a-4026-8158-e8bdc78e11ce req-bfd04313-93fc-45a0-87bf-d2005169546f service nova] Enqueued Resource ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e with Priority: HIGHEST for action security_group_members [ 1310.546736] env[65106]: INFO networking_nsxv3.common.synchronization [req-0105930b-993a-4026-8158-e8bdc78e11ce req-bfd04313-93fc-45a0-87bf-d2005169546f service nova] Enqueued Resource ID: 7f27d027-955d-497f-8253-de95b1cef83e with Priority: HIGHEST for action port [ 1310.546934] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e with Priority: HIGHEST for action security_group_rules [ 1310.547082] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e with Priority: HIGHEST for action security_group_members [ 1310.547180] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f27d027-955d-497f-8253-de95b1cef83e with Priority: HIGHEST for action port [ 1310.547764] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.547876] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.547953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.548226] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.548311] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.549565] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.549682] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.549787] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.549936] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.550119] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.550219] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.550283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.550426] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.550510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.550598] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.552796] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f27d027-955d-497f-8253-de95b1cef83e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.552796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f27d027-955d-497f-8253-de95b1cef83e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.552796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f27d027-955d-497f-8253-de95b1cef83e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.552796] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f27d027-955d-497f-8253-de95b1cef83e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.552796] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f27d027-955d-497f-8253-de95b1cef83e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.052930] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.054616] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.054616] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.054616] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f27d027-955d-497f-8253-de95b1cef83e with status ACTIVE [ 1311.054929] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.054929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.054929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.055155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.055155] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.055377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.055377] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.055522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.055636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.055636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.055815] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.055946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.055946] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.056239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.056239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.056356] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f27d027-955d-497f-8253-de95b1cef83e is going to be updated. [ 1311.077345] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.077565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.077565] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.077755] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.077851] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.078026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f27d027-955d-497f-8253-de95b1cef83e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.555666] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.058852] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.059045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.059136] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.059346] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.059430] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.059523] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e is going to be created. [ 1312.083408] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.083558] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.083633] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.083866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.084072] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.094850] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e in Status: UNINITIALIZED for 2s [ 1314.106279] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e in Status: SUCCESS [ 1314.106679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.106679] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.106927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.107152] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.107267] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.107333] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.107529] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.107579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.107636] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.107724] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.610101] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.610378] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.610433] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.610734] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.610975] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.611130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.611216] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.611414] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.611541] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.611665] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.611878] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.612021] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.612106] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.612322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.612572] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.612686] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.612753] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.612950] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.613075] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.613197] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.613319] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1315.115618] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e: rpc.has_security_group_logging(os_id): False [ 1315.135795] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.136015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.136015] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.136233] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.136323] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.136512] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.136610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.136674] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.136905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.136985] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.137287] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.137401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.137464] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.137613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.137688] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.138263] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.138263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.138263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.138263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.138263] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.138545] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e is going to be created. [ 1315.196377] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1315.196562] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1315.196609] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1315.196793] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1315.197028] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.209715] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e in Status: IN_PROGRESS for 2s [ 1315.548050] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.548249] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1316.673311] env[65106]: INFO networking_nsxv3.common.synchronization [req-fc358e28-5c36-4c14-a522-0b59e48e7c20 req-c977ab8f-554f-4ec8-b6a5-0558f3c5f537 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1316.673911] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1316.674292] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.674395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.674466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.674694] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.674927] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.675150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.675150] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.675319] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.675409] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.675503] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.941937] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.941937] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.941937] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.941937] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.942466] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.942540] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.942702] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.943053] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.943250] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.943567] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1316.943747] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1316.943942] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1316.944130] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1316.944309] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1316.944478] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1316.944736] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1316.964079] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1316.964306] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1316.964469] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1316.964692] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.965062] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-6582da06-0606-4634-ab5d-5b58b9621697 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.965248] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.965583] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.965922] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.966079] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6582da06-0606-4634-ab5d-5b58b9621697',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.179452] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.179452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.179452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.179452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.199480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.199745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.199865] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.199935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.200170] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.200253] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.200359] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 is going to be updated. [ 1317.227170] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e in Status: SUCCESS [ 1317.227385] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.228804] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.228804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.228804] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.229022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.229107] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.242920] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: IN_PROGRESS for 2s [ 1317.292843] env[65106]: INFO networking_nsxv3.common.synchronization [req-55fcbb26-b4d1-4f24-bf92-97afcbaf99fc req-6018ab83-6fc0-4840-b7e3-e284f1078e97 tempest-AttachVolumeNegativeTest-1839334076 tempest-AttachVolumeNegativeTest-1839334076-project-member] Enqueued Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_members [ 1317.293429] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 134b394e-9f92-403c-9806-46f83c6e11c4 with Priority: HIGHEST for action security_group_members [ 1317.293745] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-134b394e-9f92-403c-9806-46f83c6e11c4 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.293873] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.293939] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.294257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.294419] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.294517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.294578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.295057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.295057] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.295057] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('134b394e-9f92-403c-9806-46f83c6e11c4',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.468650] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.468912] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.468912] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.469781] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.469781] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.469781] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 6582da06-0606-4634-ab5d-5b58b9621697 not found, creating... [ 1317.469781] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.470043] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.470043] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.470219] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.471089] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.471089] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.471089] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.471089] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.471089] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.471346] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.471414] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 6582da06-0606-4634-ab5d-5b58b9621697 is going to be created. [ 1317.493752] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.493978] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.494124] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.494490] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.495216] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.496892] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.797820] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.798167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.798167] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.798269] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.822943] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.823320] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.823461] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.823559] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.823816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.823905] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.823999] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134b394e-9f92-403c-9806-46f83c6e11c4 is going to be updated. [ 1317.851826] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.852053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.852053] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.852257] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.852401] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.861833] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134b394e-9f92-403c-9806-46f83c6e11c4 in Status: IN_PROGRESS for 2s [ 1318.182877] env[65106]: INFO networking_nsxv3.common.synchronization [req-fc358e28-5c36-4c14-a522-0b59e48e7c20 req-77aec729-9861-4676-b79d-d4fe198d3637 service nova] Enqueued Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_rules [ 1318.183072] env[65106]: INFO networking_nsxv3.common.synchronization [req-fc358e28-5c36-4c14-a522-0b59e48e7c20 req-77aec729-9861-4676-b79d-d4fe198d3637 service nova] Enqueued Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1318.183212] env[65106]: INFO networking_nsxv3.common.synchronization [req-fc358e28-5c36-4c14-a522-0b59e48e7c20 req-77aec729-9861-4676-b79d-d4fe198d3637 service nova] Enqueued Resource ID: 6582da06-0606-4634-ab5d-5b58b9621697 with Priority: HIGHEST for action port [ 1318.183752] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_rules [ 1318.184191] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1318.184191] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6582da06-0606-4634-ab5d-5b58b9621697 with Priority: HIGHEST for action port [ 1318.184425] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.184634] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.184769] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.185045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.185141] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.186612] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.186612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.186612] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6582da06-0606-4634-ab5d-5b58b9621697 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.186612] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.186919] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.186966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.187090] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6582da06-0606-4634-ab5d-5b58b9621697',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.689490] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.689706] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.689819] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6582da06-0606-4634-ab5d-5b58b9621697 with status ACTIVE [ 1318.690043] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.690173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.690239] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.690436] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.690515] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.690684] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.690810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.690879] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.691042] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.691123] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.691346] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.691457] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.691527] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.691675] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.691741] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.691886] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6582da06-0606-4634-ab5d-5b58b9621697 is going to be updated. [ 1318.716770] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.717045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.717045] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.717246] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.717389] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.717546] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.250562] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: SUCCESS [ 1319.250917] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 deletion is rescheduled due to dependency. [ 1319.250917] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.251029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.251225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.251402] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1319.251514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1319.251577] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1319.251777] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1319.251842] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1319.251887] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.755761] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1319.870933] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 134b394e-9f92-403c-9806-46f83c6e11c4 in Status: SUCCESS [ 1319.871140] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 134b394e-9f92-403c-9806-46f83c6e11c4 deletion is rescheduled due to dependency. [ 1319.871258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-134b394e-9f92-403c-9806-46f83c6e11c4" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.143727] env[65106]: INFO networking_nsxv3.common.synchronization [req-4661f23b-4dd9-4d6e-a232-78a726e9f4a4 req-3d1fe54e-22ac-4543-a9c4-ae1c1d7b9c17 tempest-InstanceActionsNegativeTestJSON-1410238911 tempest-InstanceActionsNegativeTestJSON-1410238911-project-member] Enqueued Resource ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e with Priority: HIGHEST for action security_group_members [ 1320.144135] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e with Priority: HIGHEST for action security_group_members [ 1320.144400] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.144522] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.144586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.144786] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.145137] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.145137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.145137] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.145302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.145339] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.145427] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.259073] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1320.648459] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.649360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.649360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.649360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.649360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.649360] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.649360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.649360] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.649693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.649693] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.649693] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e is going to be updated. [ 1320.683249] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.683446] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.683493] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.683718] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.683885] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.694422] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e in Status: IN_PROGRESS for 2s [ 1320.761349] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.761517] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.761598] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.761810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.761901] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.762011] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 is going to be updated. [ 1320.800791] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1320.801076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1320.801076] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1320.801224] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1320.801384] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1320.810075] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: IN_PROGRESS for 2s [ 1322.705138] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e in Status: SUCCESS [ 1322.705138] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e deletion is rescheduled due to dependency. [ 1322.705138] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b0f957c-ad91-47ea-9ba5-0f19f66f5e5e" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.819676] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: SUCCESS [ 1322.819934] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.820098] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.820327] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.820519] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.820640] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.820702] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.820847] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.820929] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.821026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.821119] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.323936] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.324276] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.324454] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.324815] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.325135] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.325343] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.325479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.325785] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.325972] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.326179] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.326465] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.326659] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.326806] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.327147] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.327413] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.327578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.327724] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.327975] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.328163] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.328352] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.328528] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.831339] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b3689440-fdf4-4f9a-8a43-00a54e71ca10: rpc.has_security_group_logging(os_id): False [ 1323.849586] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.849866] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.850022] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.850330] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.850453] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.850696] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.850823] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.850927] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.851130] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.851211] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.851420] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.851610] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.851681] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.851782] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.851859] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.852121] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.852244] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.852313] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.852502] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.852586] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.852687] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 is going to be updated. [ 1323.926605] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.926904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.926904] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.927113] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.927271] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.940083] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: IN_PROGRESS for 2s [ 1325.146040] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.146040] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1325.894638] env[65106]: INFO networking_nsxv3.common.synchronization [req-8e256a52-fd91-470c-b16f-1cdaef74045f req-e892c338-10df-42ed-aab2-1f0cc40f74c5 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1325.895231] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 with Priority: HIGHEST for action security_group_members [ 1325.895704] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-b3689440-fdf4-4f9a-8a43-00a54e71ca10 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.895704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.895704] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.895926] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.896013] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.896182] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.896250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.896393] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.896479] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.896571] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b3689440-fdf4-4f9a-8a43-00a54e71ca10',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.954248] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: SUCCESS [ 1325.954845] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.965544] env[65106]: INFO networking_nsxv3.common.synchronization [req-8e256a52-fd91-470c-b16f-1cdaef74045f req-e892c338-10df-42ed-aab2-1f0cc40f74c5 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 6582da06-0606-4634-ab5d-5b58b9621697 with Priority: HIGHEST for action port [ 1325.966778] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6582da06-0606-4634-ab5d-5b58b9621697 with Priority: HIGHEST for action port [ 1325.966778] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6582da06-0606-4634-ab5d-5b58b9621697 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.966778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.966778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.966778] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.966778] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6582da06-0606-4634-ab5d-5b58b9621697',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.399458] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.399775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.399775] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.400188] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.400413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.400819] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.400966] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.401210] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.401485] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.401578] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.401682] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 is going to be updated. [ 1326.432215] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.432386] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.432434] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.432797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.432797] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.442340] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: IN_PROGRESS for 2s [ 1326.469905] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6582da06-0606-4634-ab5d-5b58b9621697 with status ACTIVE [ 1326.470039] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.470114] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.470159] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.470431] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.470504] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.470689] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.470808] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.470853] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.470996] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.471084] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.471262] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.471368] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.471429] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.471567] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.471689] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.471814] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6582da06-0606-4634-ab5d-5b58b9621697 is going to be updated. [ 1326.491653] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.491740] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.491816] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.492027] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.492171] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.492340] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6582da06-0606-4634-ab5d-5b58b9621697" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.454538] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 in Status: SUCCESS [ 1328.454538] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b3689440-fdf4-4f9a-8a43-00a54e71ca10 deletion is rescheduled due to dependency. [ 1328.454932] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b3689440-fdf4-4f9a-8a43-00a54e71ca10" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.967168] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.967840] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.968866] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.969232] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.618202] env[65106]: INFO networking_nsxv3.common.synchronization [req-9a8ad97f-4b03-47da-af28-0d31a3388161 req-7ca307da-cc1f-489a-8431-04fb7dca1946 tempest-ServerActionsTestJSON-324002004 tempest-ServerActionsTestJSON-324002004-project-member] Enqueued Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1340.618202] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8e3138f-71fe-44de-b062-382436a9dc63 with Priority: HIGHEST for action security_group_members [ 1340.618202] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-f8e3138f-71fe-44de-b062-382436a9dc63 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.618620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.618620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.618620] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.618780] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.618877] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.618963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.619109] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.619195] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.619629] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f8e3138f-71fe-44de-b062-382436a9dc63',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.122853] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.123144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.123144] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.123337] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.123437] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.123641] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.123747] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.123812] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.123977] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.124071] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.124162] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 is going to be updated. [ 1341.173424] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.173651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.173651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.173791] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.173935] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.184284] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: IN_PROGRESS for 2s [ 1343.194633] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f8e3138f-71fe-44de-b062-382436a9dc63 in Status: SUCCESS [ 1343.195077] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f8e3138f-71fe-44de-b062-382436a9dc63 deletion is rescheduled due to dependency. [ 1343.195077] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f8e3138f-71fe-44de-b062-382436a9dc63" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.618915] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.619298] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.515392] env[65106]: INFO networking_nsxv3.common.synchronization [req-864c1985-f701-4a51-94ad-d550b766867e req-ab94fade-855e-471c-b040-d35714da3da2 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1350.515933] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1350.516357] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.516466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.516466] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.516643] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.516792] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.516887] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.516947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.521183] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.521328] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.521479] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.794044] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock network-465 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.794335] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.794465] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.794736] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.795086] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.795275] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.795395] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.795606] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.795748] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.795956] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1350.796098] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] NeedRegenerationException {{(pid=65106) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1350.796212] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] no value, waiting for create lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1350.796379] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] value creation lock acquired {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1350.796500] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] No value present for key: 'zone-id' {{(pid=65106) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1350.796606] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Calling creation function for not-yet-present value {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1350.796747] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1350.823690] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1350.823878] env[65106]: DEBUG dogpile.cache.region [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65106) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1350.823982] env[65106]: DEBUG dogpile.lock [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Released creation lock {{(pid=65106) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1350.824178] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "network-465" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.824493] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7 taken with stack trace [, , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.824664] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.824783] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.825201] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.825343] env[65106]: DEBUG networking_nsxv3.api.rpc [None req-48515935-2055-436e-ab03-b49835c02f24 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f5cb9e3-1f33-4393-ac58-e455619ab0e7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.024018] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.327647] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.327857] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.328233] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.328400] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.328580] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.328758] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Segment Port 6f5cb9e3-1f33-4393-ac58-e455619ab0e7 not found, creating... [ 1351.329178] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.329451] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.329642] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.329996] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.330242] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.330693] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.330954] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.331125] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.331369] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.331507] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.331646] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Resource: SegmentPort with ID: 6f5cb9e3-1f33-4393-ac58-e455619ab0e7 is going to be created. [ 1351.351893] env[65106]: DEBUG networking_nsxv3.common.locking [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.352127] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.352313] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.352624] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.352871] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.353126] env[65106]: DEBUG oslo_concurrency.lockutils [None req-48515935-2055-436e-ab03-b49835c02f24 None None] Releasing lock "port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.526360] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.029076] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.029301] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.029413] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.029720] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.029837] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.029977] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca is going to be updated. [ 1352.032580] env[65106]: INFO networking_nsxv3.common.synchronization [req-864c1985-f701-4a51-94ad-d550b766867e req-85bfb189-9171-4573-baa9-df58d8ce824d service nova] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_rules [ 1352.032895] env[65106]: INFO networking_nsxv3.common.synchronization [req-864c1985-f701-4a51-94ad-d550b766867e req-85bfb189-9171-4573-baa9-df58d8ce824d service nova] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1352.033132] env[65106]: INFO networking_nsxv3.common.synchronization [req-864c1985-f701-4a51-94ad-d550b766867e req-85bfb189-9171-4573-baa9-df58d8ce824d service nova] Enqueued Resource ID: 6f5cb9e3-1f33-4393-ac58-e455619ab0e7 with Priority: HIGHEST for action port [ 1352.033840] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_rules [ 1352.034045] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1352.034246] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6f5cb9e3-1f33-4393-ac58-e455619ab0e7 with Priority: HIGHEST for action port [ 1352.035559] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.035736] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.035855] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.036225] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.036311] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.037776] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.037971] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.038257] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7 taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.038395] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.038481] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.038703] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.038804] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6f5cb9e3-1f33-4393-ac58-e455619ab0e7',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1352.066090] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.066302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.066302] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.066480] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.066617] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.075494] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: IN_PROGRESS for 2s [ 1352.538415] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.538733] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.540946] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6f5cb9e3-1f33-4393-ac58-e455619ab0e7 with status ACTIVE [ 1352.541149] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.541268] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.541336] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.541551] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.541638] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.541804] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.541900] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.541963] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.542370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.542370] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.542370] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.542571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.542571] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.542680] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.542719] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.542801] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6f5cb9e3-1f33-4393-ac58-e455619ab0e7 is going to be updated. [ 1352.563515] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1352.563707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1352.563707] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1352.563914] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1352.564065] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1352.564231] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6f5cb9e3-1f33-4393-ac58-e455619ab0e7" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.086641] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: SUCCESS [ 1354.087090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.087090] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.087283] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.087477] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1354.087594] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1354.087658] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1354.087810] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1354.087892] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1354.087989] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1354.591025] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.093090] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.596176] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.596411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.596411] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.596626] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.596721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.596823] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca is going to be updated. [ 1355.649449] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.649721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.649721] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.650029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.650142] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.662231] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: IN_PROGRESS for 2s [ 1357.035380] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1357.035752] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1357.674959] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: SUCCESS [ 1357.675202] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.675382] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.675613] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.675804] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1357.675925] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1357.675992] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1357.676181] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1357.676322] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.676451] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1357.676451] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.178623] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.682031] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2a2be5f5-efc1-4508-8ee3-6d684d4520ca: rpc.has_security_group_logging(os_id): False [ 1358.701127] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.701341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.701341] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.701540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.720951] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.721280] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.721432] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.721509] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.721651] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.721732] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.721823] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca is going to be updated. [ 1358.785675] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.785953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.785953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.786102] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.786260] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.799135] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: IN_PROGRESS for 2s [ 1360.815224] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: SUCCESS [ 1360.815628] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.037497] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1362.037806] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1367.039652] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1367.039652] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1372.041196] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.041603] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.042089] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.042462] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.043599] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.043980] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.044508] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.044890] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1392.045702] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1392.046120] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1397.047644] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1397.047644] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1402.049140] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1402.049140] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1407.049998] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1407.050380] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.051358] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1412.051746] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1417.052343] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1417.052343] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1420.208551] env[65106]: INFO networking_nsxv3.common.synchronization [req-a13af1b5-bb8e-41f6-8e24-c810c8090d2b req-01c7ca0a-25e4-4c55-b100-a29832c6b795 tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1420.209081] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1420.209387] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.209510] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.209579] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.209820] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.210135] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1420.210135] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1420.210282] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1420.210419] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1420.210540] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1420.210646] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1420.714108] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.215590] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1421.718330] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.718629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.718629] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.718788] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.718888] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.718990] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca is going to be updated. [ 1421.754085] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1421.754310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1421.754310] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1421.754496] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1421.754653] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1421.762794] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: IN_PROGRESS for 2s [ 1423.773669] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: SUCCESS [ 1423.773669] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1425.210758] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1425.211221] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1430.212222] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1430.212593] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.213939] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1435.214310] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.460532] env[65106]: INFO networking_nsxv3.common.synchronization [req-336abcc7-f66d-4e94-a060-b20c8257e1ce req-7d1e90fe-5b4b-4b50-91a5-cb3fadce68ed tempest-ServerActionsTestOtherA-1995773774 tempest-ServerActionsTestOtherA-1995773774-project-member] Enqueued Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1435.461024] env[65106]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca with Priority: HIGHEST for action security_group_members [ 1435.461329] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca taken with stack trace [, , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.461452] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.461514] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.461710] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.461861] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.461953] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.462026] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.462173] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.462258] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.462348] env[65106]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2a2be5f5-efc1-4508-8ee3-6d684d4520ca',) {} {{(pid=65106) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.968093] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.968332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.968332] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.968548] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.968671] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.968855] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.968947] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.969029] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.969172] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.969250] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.969333] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca is going to be updated. [ 1435.998204] env[65106]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65106) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.998204] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.998347] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.998460] env[65106]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.998599] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.009307] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: IN_PROGRESS for 2s [ 1438.020728] env[65106]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca in Status: SUCCESS [ 1438.021175] env[65106]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2a2be5f5-efc1-4508-8ee3-6d684d4520ca deletion is rescheduled due to dependency. [ 1438.021175] env[65106]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2a2be5f5-efc1-4508-8ee3-6d684d4520ca" {{(pid=65106) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.461617] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1440.461909] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1445.463098] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.463454] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1450.463927] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1450.463927] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1455.464639] env[65106]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1455.465103] env[65106]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0